Jul 03 12:35:04 devstack cinder-volume[75618]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 12:35:04 devstack cinder-volume[75618]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 12:35:04 devstack cinder-volume[75618]: we strongly recommend against using it for new projects. Jul 03 12:35:04 devstack cinder-volume[75618]: If you are already using Eventlet, we recommend migrating to a different Jul 03 12:35:04 devstack cinder-volume[75618]: framework. For more detail see Jul 03 12:35:04 devstack cinder-volume[75618]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 12:35:04 devstack cinder-volume[75618]: import eventlet # noqa Jul 03 12:35:07 devstack cinder-volume[75618]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:35:07 devstack cinder-volume[75618]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:35:07 devstack cinder-volume[75618]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:35:08 devstack cinder-volume[75618]: INFO dbcounter [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Registered counter for database cinder Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG dbcounter [-] [75618] Writer thread running {{(pid=75618) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 12:35:08 devstack cinder-volume[75618]: INFO cinder.rpc [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 12:35:08 devstack cinder-volume[75618]: INFO cinder.rpc [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:35:08 devstack cinder-volume[75618]: INFO cinder.volume.manager [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Determined volume DB was empty at startup. Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG cinder.volume.manager [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75618) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 12:35:08 devstack cinder-volume[75618]: INFO cinder.volume.manager [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 12:35:08 devstack cinder-volume[75618]: WARNING stevedore.named [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 12:35:08 devstack cinder-volume[75618]: WARNING castellan.key_manager [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:35:08 devstack cinder-volume[75618]: WARNING cinder.keymgr.conf_key_mgr [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG cinder.volume.drivers.lvm [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75618) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG oslo_concurrency.processutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:08 devstack cinder-volume[75618]: DEBUG oslo_concurrency.processutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] CMD "cinder-rtstool verify" returned: 0 in 0.405s {{(pid=75618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:35:09 devstack cinder-volume[75618]: INFO cinder.rpc [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 12:35:09 devstack cinder-volume[75618]: INFO cinder.rpc [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 12:35:09 devstack cinder-volume[75618]: WARNING stevedore.named [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 12:35:09 devstack cinder-volume[75618]: WARNING castellan.key_manager [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:35:09 devstack cinder-volume[75618]: INFO cinder.volume.manager [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:35:09 devstack cinder-volume[75618]: INFO oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Starting 1 workers Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Started child 75804 {{(pid=75618) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Full set of CONF: {{(pid=75618) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] ******************************************************************************** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Configuration options gathered from: {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] ================================================================================ {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] allow_availability_zone_fallback = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] allow_compression_on_image_upload = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] allowed_direct_url_schemes = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] api_rate_limit = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] auth_strategy = keystone {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] az_cache_duration = 3600 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_availability_zone = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_host = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_stats_polling_interval = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backup_api_class = cinder.backup.api.API {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75804]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backup_name_template = backup-%s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backup_use_same_host = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backup_use_temp_snapshot = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] chap_password = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] chap_username = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_internal_tenant_project_id = 834a85d156734f75a2abc87d335831da {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_internal_tenant_user_id = 7e2417fcc9f04edb8e0070a554014b54 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cloned_volume_same_az = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cluster = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] compression_format = gzip {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] compute_api_class = cinder.compute.nova.API {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] config_dir = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] config_source = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] control_exchange = openstack {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] debug = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] default_availability_zone = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] default_group_type = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] default_volume_type = lvmdriver-1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] disk_geometry = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] driver_client_cert = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] driver_client_cert_key = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] driver_data_namespace = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] driver_ssl_cert_path = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] driver_ssl_cert_verify = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] driver_use_ssl = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] enable_force_upload = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] enable_new_services = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] enable_unsupported_driver = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] enforce_multipath_for_image_xfer = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] filter_function = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_api_insecure = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_api_ssl_compression = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_ca_certificates_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_catalog_info = image:glance:publicURL {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack sudo[75808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_num_retries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance_request_timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] goodness_function = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] graceful_shutdown_timeout = 5 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] group_api_class = cinder.group.api.API {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] host = devstack {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack sudo[75808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_compress_on_upload = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_conversion_address_space_limit = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_conversion_cpu_limit = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_conversion_disable = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_upload_use_cinder_backend = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_upload_use_internal_tenant = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_volume_cache_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_volume_cache_max_count = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] image_volume_cache_max_size_gb = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] init_host_max_objects_retrieval = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] instance_format = [instance: %(uuid)s] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] iscsi_target_flags = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] iscsi_write_cache = on {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] iser_helper = tgtadm {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] iser_ip_address = 192.168.122.245 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] iser_port = 3260 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_color = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_config_append = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_dir = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_options = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_rotate_interval = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_rotate_interval_type = days {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] log_rotation_type = none {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] max_age = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] max_logfile_count = 30 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] max_logfile_size_mb = 200 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] max_over_subscription_ratio = 20.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] message_reap_interval = 86400 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] message_ttl = 2592000 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] migration_create_volume_timeout_secs = 300 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] monkey_patch = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] monkey_patch_modules = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] my_ip = 192.168.122.245 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] no_snapshot_gb_quota = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] num_iser_scan_tries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] num_shell_tries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] num_volume_device_scan_tries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] nvmeof_conn_info_version = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] nvmet_ns_id = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] nvmet_port_id = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_max_limit = 1000 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_volume_ext_list = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_volume_listen_port = 8776 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_volume_use_ssl = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] osapi_volume_workers = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] per_volume_size_limit = -1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] periodic_fuzzy_delay = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] periodic_interval = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] public_endpoint = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] publish_errors = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_backup_gigabytes = 1000 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_backups = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_gigabytes = 1000 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_groups = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_snapshots = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] quota_volumes = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] rate_limit_burst = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] rate_limit_except_level = CRITICAL {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] rate_limit_interval = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] reinit_driver_count = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] replication_device = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] report_discard_supported = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] report_interval = 120 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] reservation_clean_interval = 86400 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] reservation_expire = 86400 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] reserved_image_namespaces = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] reserved_percentage = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] rpc_response_timeout = 120 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] run_external_periodic_tasks = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] scst_target_driver = iscsi {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] scst_target_iqn_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_down_time = 720 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] shell_completion = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] snapshot_name_template = snapshot-%s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] snapshot_same_host = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] split_loggers = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] state_path = /opt/stack/data/cinder {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] storage_availability_zone = nova {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] storage_protocol = iSCSI {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] syslog_log_facility = LOG_USER {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] target_helper = lioadm {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] target_ip_address = 192.168.122.245 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] target_port = 3260 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] target_protocol = iscsi {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] target_secondary_ip_addresses = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] trace_flags = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] transport_url = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] until_refresh = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_chap_auth = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_default_quota_class = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_journal = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_json = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_multipath_for_image_xfer = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_stderr = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] use_syslog = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] verify_glance_signatures = enabled {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_api_class = cinder.volume.api.API {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_backend_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_clear = zero {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_clear_ionice = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_clear_size = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_copy_bps_limit = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_dd_blocksize = 1M {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_name_template = volume-%s {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_service_inithost_offload = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volume_usage_audit_period = month {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] zoning_mode = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_concurrency.disable_process_locking = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.auth_section = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.auth_type = password {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.auth_version = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.cache = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.include_service_catalog = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.insecure = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.interface = public {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_password = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcache_username = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.region_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.service_type = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.backend = dogpile.cache.null {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.backend_argument = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.backend_expiration_time = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.config_prefix = cache.oslo {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.debug_cache_backend = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.enable_retry_client = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.enable_socket_keepalive = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.expiration_time = 600 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.hashclient_retry_attempts = 2 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_dead_retry = 300 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_pool_maxsize = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_sasl_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.password = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.proxies = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.redis_db = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.redis_server = localhost:6379 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.retry_attempts = 2 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.retry_delay = 0.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.socket_keepalive_count = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.socket_keepalive_idle = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.socket_keepalive_interval = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.socket_timeout = 1.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.tls_allowed_ciphers = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.tls_cafile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.tls_certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.tls_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.tls_keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cache.username = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] coordination.backend_url = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.asyncio_connection = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.asyncio_slave_connection = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.backend = sqlalchemy {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.connection = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.connection_debug = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.connection_parameters = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.connection_recycle_time = 3600 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.connection_trace = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.db_inc_retry_interval = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.db_max_retries = 20 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.db_max_retry_interval = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.db_retry_interval = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.max_overflow = 50 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.max_pool_size = 5 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.max_retries = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.mysql_wsrep_sync_wait = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.pool_timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.retry_interval = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.slave_connection = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.sqlite_synchronous = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.synchronous_reader = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] database.use_db_reconnect = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.connection_string = messaging:// {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.es_doc_type = notification {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.es_scroll_size = 10000 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.es_scroll_time = 2m {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.filter_error_trace = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.hmac_keys = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.sentinel_service_name = mymaster {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.socket_timeout = 0.1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.trace_requests = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler.trace_sqlalchemy = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler_jaeger.process_tags = {} {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:09 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler_jaeger.service_name_prefix = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] profiler_otlp.service_name_prefix = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.enforce_new_defaults = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.enforce_scope = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.policy_default_rule = default {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.policy_file = policy.yaml {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.group = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.helper_command = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] privsep_osbrick.user = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.group = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.helper_command = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] cinder_sys_admin.user = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.auth_section = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.auth_type = password {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.cafile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.collect_timing = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.insecure = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.send_service_user_token = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.split_loggers = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] service_user.timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.auth_section = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.auth_type = password {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.collect_timing = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.insecure = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.region_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.split_loggers = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] glance.timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.backend_availability_zone = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.chap_password = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.chap_username = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.disk_geometry = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.driver_client_cert = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.driver_client_cert_key = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.driver_data_namespace = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.driver_use_ssl = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.extra_capabilities = {} {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.filter_function = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.goodness_function = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.iscsi_target_flags = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.iscsi_write_cache = on {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.iser_helper = tgtadm {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.iser_port = 3260 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.lvm_share_target = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.lvm_type = auto {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.num_shell_tries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.replication_device = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.report_discard_supported = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.reserved_percentage = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.target_helper = tgtadm {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.target_port = 3260 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.target_protocol = iscsi {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.trace_flags = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.unique_fqdn_network = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.use_chap_auth = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_backend_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_clear = zero {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_clear_ionice = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_clear_size = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_reports.file_event_handler = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_reports.log_dir = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.backend_host = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.chap_password = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.chap_username = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.disk_geometry = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.driver_client_cert = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.extra_capabilities = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.filter_function = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.goodness_function = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.iser_helper = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.iser_ip_address = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.iser_port = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.lvm_share_target = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.lvm_type = auto {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.num_shell_tries = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.replication_device = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.report_discard_supported = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.reserved_percentage = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.scst_target_driver = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.storage_protocol = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.target_helper = lioadm {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.target_ip_address = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.target_port = 3260 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.trace_flags = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.use_chap_auth = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_clear = zero {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_clear_size = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] lvmdriver-1.volumes_dir = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_notifications.driver = [] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_notifications.retry = -1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] key_manager.fixed_key = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.barbican_api_version = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.barbican_endpoint = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.barbican_endpoint_type = public {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.barbican_region_name = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.cafile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.collect_timing = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.insecure = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.number_of_retries = 60 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.retry_delay = 1 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.send_service_user_token = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.split_loggers = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.verify_ssl = True {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican.verify_ssl_path = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.auth_section = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.auth_type = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.cafile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.certfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.collect_timing = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.insecure = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.keyfile = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.split_loggers = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] barbican_service_user.timeout = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.approle_role_id = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.approle_secret_id = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.kv_mountpoint = secret {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.kv_path = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.kv_version = 2 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.namespace = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.root_token_id = **** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.ssl_ca_crt_file = None {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.timeout = 60.0 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.use_ssl = False {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:35:10 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] ******************************************************************************** {{(pid=75618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 12:35:10 devstack sudo[75808]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:10 devstack sudo[76024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:10 devstack sudo[76024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:10 devstack sudo[76024]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.619s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:35:10 devstack cinder-volume[75804]: INFO cinder.brick.local_dev.lvm [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:10 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:35:10 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:11 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:11 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:11 devstack cinder-volume[75804]: DEBUG cinder.brick.local_dev.lvm [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75804) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 12:35:11 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:11 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:11 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:12 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:12 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.029s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:12 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:12 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:12 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:12 devstack sudo[76579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:12 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.760s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:13 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:13 devstack sudo[76586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 12:35:13 devstack sudo[76586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:14 devstack sudo[76586]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:14 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.658s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:14 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:14 devstack sudo[76591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:35:14 devstack sudo[76591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:14 devstack sudo[76591]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:14 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:14 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:14 devstack sudo[76597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:35:14 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:15 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:15 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.769s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:15 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:15 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:15 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:16 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.854s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:16 devstack sudo[76613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:16 devstack sudo[76613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:17 devstack sudo[76613]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.867s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:17 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:17 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:18 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.826s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:18 devstack cinder-volume[75804]: INFO cinder.volume.drivers.lvm [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:18 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:18 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:18 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.777s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:35:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:18 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:35:18 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:19 devstack cinder-volume[75618]: DEBUG dbcounter [-] [75618] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75618) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:35:19 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:19 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:19 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:20 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:20 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:20 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:20 devstack sudo[76894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:20 devstack sudo[76894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:20 devstack sudo[76894]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:20 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:20 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:20 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:20 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:21 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:21 devstack cinder-volume[75804]: INFO cinder.volume.driver [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG cinder.volume.driver [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75804) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG oslo_db.sqlalchemy.engines [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writer thread running {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG cinder.db.sqlalchemy.api [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Building query based on filter {{(pid=75804) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG cinder.image.image_utils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75804) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 12:35:21 devstack cinder-volume[75804]: INFO cinder.keymgr.migration [None req-7f5dcc5f-b872-4593-be8d-74dc1f1a192c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:35:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:21 devstack sudo[76901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:35:21 devstack sudo[76901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:22 devstack sudo[76901]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:22 devstack sudo[76905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:22 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:22 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:22 devstack sudo[76911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:22 devstack sudo[76911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:23 devstack sudo[76911]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:23 devstack sudo[76915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:23 devstack sudo[76915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:24 devstack sudo[76915]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.771s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:24 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:35:24 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Driver initialization completed successfully. Jul 03 12:35:24 devstack cinder-volume[75804]: INFO cinder.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Initiating service 2 cleanup Jul 03 12:35:24 devstack cinder-volume[75804]: INFO cinder.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Service 2 cleanup completed. Jul 03 12:35:24 devstack cinder-volume[75804]: DEBUG cinder.service [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Creating RPC server for service cinder-volume {{(pid=75804) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 12:35:24 devstack cinder-volume[75804]: DEBUG cinder.service [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75804) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 12:35:24 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 12:35:24 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:35:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:24 devstack sudo[76919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:35:24 devstack sudo[76919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:25 devstack sudo[76919]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:25 devstack sudo[76923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:25 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:26 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.765s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:26 devstack sudo[76929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:35:26 devstack sudo[76929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:26 devstack sudo[76929]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:35:26 devstack sudo[76986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:35:26 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:35:27 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root Jul 03 12:35:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:35:27 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-e635bf54-e59d-47f2-9be4-12458d00b312 None None] Driver post RPC initialization completed successfully. Jul 03 12:35:37 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:35:37 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:36:16 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:36:16 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:36:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:36:16 devstack sudo[78643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:36:16 devstack sudo[78643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:36:17 devstack sudo[78643]: pam_unix(sudo:session): session closed for user root Jul 03 12:36:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:36:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:36:17 devstack sudo[78646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:36:17 devstack sudo[78646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:36:17 devstack sudo[78646]: pam_unix(sudo:session): session closed for user root Jul 03 12:36:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:36:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:36:17 devstack sudo[78650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:36:17 devstack sudo[78650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:36:18 devstack sudo[78650]: pam_unix(sudo:session): session closed for user root Jul 03 12:36:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.714s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:36:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:36:18 devstack sudo[78653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:36:18 devstack sudo[78653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:36:19 devstack sudo[78653]: pam_unix(sudo:session): session closed for user root Jul 03 12:36:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:36:19 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:37:16 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:37:16 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:37:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:37:16 devstack sudo[78976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:37:16 devstack sudo[78976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:37:17 devstack sudo[78976]: pam_unix(sudo:session): session closed for user root Jul 03 12:37:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:37:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:37:17 devstack sudo[78979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:37:17 devstack sudo[78979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:37:17 devstack sudo[78979]: pam_unix(sudo:session): session closed for user root Jul 03 12:37:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:37:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:37:17 devstack sudo[78983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:37:17 devstack sudo[78983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:37:18 devstack sudo[78983]: pam_unix(sudo:session): session closed for user root Jul 03 12:37:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:37:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:37:18 devstack sudo[78986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:37:18 devstack sudo[78986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:37:19 devstack sudo[78986]: pam_unix(sudo:session): session closed for user root Jul 03 12:37:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:37:19 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:37:37 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:37:37 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:38:16 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:38:16 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:38:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:38:16 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:38:16 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:38:17 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Jul 03 12:38:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:38:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:38:17 devstack sudo[82027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:38:17 devstack sudo[82027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:38:17 devstack sudo[82027]: pam_unix(sudo:session): session closed for user root Jul 03 12:38:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:38:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:38:17 devstack sudo[82038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:38:17 devstack sudo[82038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:38:18 devstack sudo[82038]: pam_unix(sudo:session): session closed for user root Jul 03 12:38:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:38:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:38:18 devstack sudo[82043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:38:18 devstack sudo[82043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:38:19 devstack sudo[82043]: pam_unix(sudo:session): session closed for user root Jul 03 12:38:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:38:19 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:39:16 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:39:16 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:39:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:39:16 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:39:16 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:39:17 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Jul 03 12:39:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:39:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:39:17 devstack sudo[83922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:39:17 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:39:17 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root Jul 03 12:39:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:39:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:39:17 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:39:17 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:39:18 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Jul 03 12:39:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:39:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:39:18 devstack sudo[83972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:39:18 devstack sudo[83972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:39:19 devstack sudo[83972]: pam_unix(sudo:session): session closed for user root Jul 03 12:39:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.864s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:39:19 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:39:37 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:40:16 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:40:16 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 12:40:16 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:16 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 12:40:16 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:17 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:17 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:40:17 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:17 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:17 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:17 devstack sudo[85223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 12:40:17 devstack sudo[85223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:18 devstack sudo[85223]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:18 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:18 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 12:40:18 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:19 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:19 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:19 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-a065adc7-9125-4a2d-aaca-72503e2f1523 None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:40:47 devstack cinder-volume[75618]: INFO oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Caught SIGTERM, stopping children Jul 03 12:40:47 devstack cinder-volume[75618]: DEBUG oslo_concurrency.lockutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Acquiring lock "singleton_lock" {{(pid=75618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:40:47 devstack cinder-volume[75618]: DEBUG oslo_concurrency.lockutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Acquired lock "singleton_lock" {{(pid=75618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:40:47 devstack cinder-volume[75618]: DEBUG oslo_concurrency.lockutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Releasing lock "singleton_lock" {{(pid=75618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:40:47 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Stop services. {{(pid=75618) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 12:40:47 devstack cinder-volume[75618]: DEBUG oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Killing children. {{(pid=75618) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 12:40:47 devstack cinder-volume[75618]: INFO oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Waiting on 1 children to exit Jul 03 12:40:49 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Acquiring lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:40:49 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Acquired lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:40:49 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Releasing lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:40:49 devstack cinder-volume[75804]: WARNING amqp [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 12:40:49 devstack cinder-volume[75804]: WARNING amqp [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 12:40:49 devstack cinder-volume[75618]: INFO oslo_service.backend._eventlet.service [None req-9b1b6364-df29-4616-a61d-9c75fe90a246 None None] Child 75804 exited with status 0 Jul 03 12:40:50 devstack cinder-volume[86012]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 12:40:50 devstack cinder-volume[86012]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 12:40:50 devstack cinder-volume[86012]: we strongly recommend against using it for new projects. Jul 03 12:40:50 devstack cinder-volume[86012]: If you are already using Eventlet, we recommend migrating to a different Jul 03 12:40:50 devstack cinder-volume[86012]: framework. For more detail see Jul 03 12:40:50 devstack cinder-volume[86012]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 12:40:50 devstack cinder-volume[86012]: import eventlet # noqa Jul 03 12:40:52 devstack cinder-volume[86012]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:40:52 devstack cinder-volume[86012]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:40:52 devstack cinder-volume[86012]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:40:52 devstack cinder-volume[86012]: INFO dbcounter [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Registered counter for database cinder Jul 03 12:40:52 devstack cinder-volume[86012]: DEBUG oslo_db.sqlalchemy.engines [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG dbcounter [-] [86012] Writer thread running {{(pid=86012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 12:40:53 devstack cinder-volume[86012]: INFO cinder.rpc [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 12:40:53 devstack cinder-volume[86012]: INFO cinder.rpc [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_db.sqlalchemy.engines [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:40:53 devstack cinder-volume[86012]: INFO cinder.volume.manager [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Determined volume DB was empty at startup. Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG cinder.volume.manager [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86012) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 12:40:53 devstack cinder-volume[86012]: INFO cinder.volume.manager [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 12:40:53 devstack cinder-volume[86012]: WARNING stevedore.named [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 12:40:53 devstack cinder-volume[86012]: WARNING castellan.key_manager [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:40:53 devstack cinder-volume[86012]: WARNING cinder.keymgr.conf_key_mgr [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:40:53 devstack cinder-volume[86012]: INFO cinder.volume.manager [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_db.sqlalchemy.engines [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:40:53 devstack cinder-volume[86012]: INFO oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Starting 1 workers Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Started child 86224 {{(pid=86012) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Full set of CONF: {{(pid=86012) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] ******************************************************************************** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Configuration options gathered from: {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] ================================================================================ {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 12:40:53 devstack cinder-volume[86224]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] allow_availability_zone_fallback = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] allow_compression_on_image_upload = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] allowed_direct_url_schemes = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] api_rate_limit = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] auth_strategy = keystone {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_availability_zone = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_host = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_stats_polling_interval = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backup_api_class = cinder.backup.api.API {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backup_name_template = backup-%s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backup_use_same_host = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backup_use_temp_snapshot = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] chap_password = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] chap_username = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_internal_tenant_project_id = 834a85d156734f75a2abc87d335831da {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_internal_tenant_user_id = 7e2417fcc9f04edb8e0070a554014b54 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cluster = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] compression_format = gzip {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] compute_api_class = cinder.compute.nova.API {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] config_dir = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] config_source = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] control_exchange = openstack {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] debug = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] default_availability_zone = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] default_group_type = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] default_volume_type = QuobyteHD {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] disk_geometry = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] driver_client_cert = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] driver_client_cert_key = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] driver_data_namespace = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] driver_ssl_cert_path = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] driver_ssl_cert_verify = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] driver_use_ssl = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] enable_new_services = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] enable_unsupported_driver = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] enabled_backends = ['QuobyteHD'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] enforce_multipath_for_image_xfer = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] filter_function = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_api_insecure = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_api_ssl_compression = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_ca_certificates_file = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_catalog_info = image:glance:publicURL {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_num_retries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance_request_timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] goodness_function = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] graceful_shutdown_timeout = 5 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] group_api_class = cinder.group.api.API {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] host = devstack {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_compress_on_upload = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_conversion_address_space_limit = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_conversion_cpu_limit = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_conversion_disable = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_upload_use_cinder_backend = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_upload_use_internal_tenant = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_volume_cache_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_volume_cache_max_count = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] image_volume_cache_max_size_gb = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] init_host_max_objects_retrieval = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] instance_format = [instance: %(uuid)s] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] iscsi_target_flags = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] iscsi_write_cache = on {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] iser_helper = tgtadm {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] iser_ip_address = 192.168.122.245 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] iser_port = 3260 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_color = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_config_append = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.remotefs [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86224) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_dir = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_file = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_options = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_rotate_interval = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_rotate_interval_type = days {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] log_rotation_type = none {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] max_age = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] max_logfile_count = 30 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] max_logfile_size_mb = 200 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] max_over_subscription_ratio = 20.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] message_reap_interval = 86400 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] message_ttl = 2592000 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] migration_create_volume_timeout_secs = 300 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] monkey_patch = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] monkey_patch_modules = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] my_ip = 192.168.122.245 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] no_snapshot_gb_quota = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] num_iser_scan_tries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] num_shell_tries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] num_volume_device_scan_tries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] nvmeof_conn_info_version = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] nvmet_ns_id = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] nvmet_port_id = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_max_limit = 1000 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_volume_ext_list = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_volume_listen_port = 8776 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_volume_use_ssl = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] osapi_volume_workers = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] per_volume_size_limit = -1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] periodic_fuzzy_delay = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] periodic_interval = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] public_endpoint = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] publish_errors = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_backup_gigabytes = 1000 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_backups = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_gigabytes = 1000 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_groups = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_snapshots = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] quota_volumes = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] rate_limit_burst = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] rate_limit_except_level = CRITICAL {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] rate_limit_interval = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] reinit_driver_count = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] replication_device = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] report_discard_supported = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] report_interval = 120 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] reservation_clean_interval = 86400 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] reservation_expire = 86400 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] reserved_image_namespaces = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] reserved_percentage = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] rpc_response_timeout = 120 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] run_external_periodic_tasks = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] scst_target_driver = iscsi {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] scst_target_iqn_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_down_time = 720 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] shell_completion = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] snapshot_name_template = snapshot-%s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] split_loggers = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] state_path = /opt/stack/data/cinder {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] storage_availability_zone = nova {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] storage_protocol = iSCSI {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] syslog_log_facility = LOG_USER {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] target_helper = lioadm {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] target_ip_address = 192.168.122.245 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] target_port = 3260 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] target_protocol = iscsi {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] target_secondary_ip_addresses = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] trace_flags = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] transport_url = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] until_refresh = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_chap_auth = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_default_quota_class = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_journal = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_json = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_multipath_for_image_xfer = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_stderr = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] use_syslog = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] verify_glance_signatures = enabled {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_api_class = cinder.volume.api.API {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_backend_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_clear = zero {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_clear_ionice = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_clear_size = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_copy_bps_limit = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_dd_blocksize = 1M {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_name_template = volume-%s {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_service_inithost_offload = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volume_usage_audit_period = month {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] zoning_mode = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_concurrency.disable_process_locking = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.auth_section = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.auth_type = password {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.auth_version = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.cache = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.include_service_catalog = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.insecure = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.interface = public {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_password = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86224) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86224]: WARNING cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 12:40:53 devstack cinder-volume[86224]: WARNING cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Running cmd (subprocess): mount.quobyte {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcache_username = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.region_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.service_type = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.backend = dogpile.cache.null {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.backend_argument = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.backend_expiration_time = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.config_prefix = cache.oslo {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.debug_cache_backend = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.enable_retry_client = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.enable_socket_keepalive = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.expiration_time = 600 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.hashclient_retry_attempts = 2 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_dead_retry = 300 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_pool_maxsize = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_sasl_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.password = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.proxies = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.redis_db = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.redis_server = localhost:6379 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.retry_attempts = 2 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.retry_delay = 0.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.socket_keepalive_count = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.socket_keepalive_idle = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.socket_keepalive_interval = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.socket_timeout = 1.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.tls_allowed_ciphers = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.tls_cafile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.tls_certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.tls_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.tls_keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cache.username = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] coordination.backend_url = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.asyncio_connection = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.asyncio_slave_connection = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.backend = sqlalchemy {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.connection = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.connection_debug = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.connection_parameters = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.connection_recycle_time = 3600 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.connection_trace = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.db_inc_retry_interval = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.db_max_retries = 20 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.db_max_retry_interval = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.db_retry_interval = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.max_overflow = 50 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.max_pool_size = 5 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack quobyte-client[86225]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.max_retries = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.mysql_wsrep_sync_wait = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.pool_timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.retry_interval = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.slave_connection = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.sqlite_synchronous = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack quobyte-client[86225]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.synchronous_reader = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] database.use_db_reconnect = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:40:53 devstack cinder-volume[86224]: INFO cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 ... Jul 03 12:40:53 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 -c /etc/quobyte/client-cinder.cfg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.connection_string = messaging:// {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.es_doc_type = notification {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.es_scroll_size = 10000 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.es_scroll_time = 2m {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.filter_error_trace = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.hmac_keys = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.sentinel_service_name = mymaster {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.socket_timeout = 0.1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.trace_requests = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler.trace_sqlalchemy = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler_jaeger.process_tags = {} {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler_jaeger.service_name_prefix = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] profiler_otlp.service_name_prefix = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.enforce_new_defaults = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.enforce_scope = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.policy_default_rule = default {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.policy_file = policy.yaml {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.group = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.helper_command = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 -c /etc/quobyte/client-cinder.cfg Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] privsep_osbrick.user = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.group = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.helper_command = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] cinder_sys_admin.user = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.auth_section = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.auth_type = password {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.cafile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.collect_timing = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.insecure = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.send_service_user_token = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.split_loggers = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] service_user.timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.auth_section = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.auth_type = password {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.collect_timing = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.insecure = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.region_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.split_loggers = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] glance.timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.backend_availability_zone = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.chap_password = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.chap_username = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.disk_geometry = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.driver_client_cert = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.driver_client_cert_key = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.driver_data_namespace = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.driver_use_ssl = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.extra_capabilities = {} {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.filter_function = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.goodness_function = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.iscsi_target_flags = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.iscsi_write_cache = on {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.iser_helper = tgtadm {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.iser_port = 3260 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_host = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_login = admin {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_mount_options = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_password = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:53 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_private_key = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_share_path = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.num_shell_tries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.quobyte_volume_url = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.replication_device = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.report_discard_supported = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.reserved_percentage = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.target_helper = tgtadm {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.target_port = 3260 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.target_protocol = iscsi {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.trace_flags = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.unique_fqdn_network = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.use_chap_auth = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_backend_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_clear = zero {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_clear_ionice = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_clear_size = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_reports.file_event_handler = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_reports.log_dir = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.backend_availability_zone = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.backend_host = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.chap_password = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.chap_username = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.chiscsi_conf = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.disk_geometry = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.driver_client_cert = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.driver_data_namespace = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.driver_use_ssl = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.extra_capabilities = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.filter_function = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.goodness_function = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.iser_helper = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.iser_ip_address = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.iser_port = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.iser_target_prefix = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_host = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_login = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_mount_options = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_password = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_private_key = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_share_path = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_ssh_port = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.num_shell_tries = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.nvmet_port_id = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.replication_device = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.report_discard_supported = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.reserved_percentage = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.scst_target_driver = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.storage_protocol = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.target_helper = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.target_ip_address = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.target_port = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.target_prefix = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.target_protocol = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.trace_flags = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.use_chap_auth = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_clear = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_clear_size = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] QuobyteHD.volumes_dir = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_notifications.driver = [] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_notifications.retry = -1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] key_manager.fixed_key = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.barbican_api_version = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.barbican_endpoint = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.barbican_endpoint_type = public {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.barbican_region_name = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.cafile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.collect_timing = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.insecure = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.number_of_retries = 60 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.retry_delay = 1 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.send_service_user_token = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.split_loggers = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.verify_ssl = True {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican.verify_ssl_path = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.auth_section = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.auth_type = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.cafile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.certfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.collect_timing = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.insecure = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.keyfile = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.split_loggers = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] barbican_service_user.timeout = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.approle_role_id = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.approle_secret_id = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.kv_mountpoint = secret {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.kv_path = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.kv_version = 2 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.namespace = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.root_token_id = **** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.ssl_ca_crt_file = None {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.timeout = 60.0 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.use_ssl = False {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:40:54 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] ******************************************************************************** {{(pid=86012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 12:40:54 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:54 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.832s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:54 devstack cinder-volume[86224]: INFO cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 succeeded Jul 03 12:40:54 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:40:54 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.844s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:40:54 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:54 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:40:54 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:55 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.643s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:55 devstack cinder-volume[86224]: INFO cinder.volume.driver [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Driver hasn't implemented _init_vendor_properties() Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG cinder.volume.driver [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.750431060791, 'free_capacity_gb': 1775.750431060791, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86224) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG oslo_db.sqlalchemy.engines [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG dbcounter [-] [86224] Writer thread running {{(pid=86224) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG cinder.db.sqlalchemy.api [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Building query based on filter {{(pid=86224) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG cinder.image.image_utils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86224) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 12:40:55 devstack cinder-volume[86224]: INFO cinder.keymgr.migration [None req-2e297419-0f93-4306-a45e-dc3a872365ec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:40:55 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:55 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:40:55 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:56 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.688s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG cinder.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Notifying Schedulers of capabilities ... {{(pid=86224) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:40:56 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Driver initialization completed successfully. Jul 03 12:40:56 devstack cinder-volume[86224]: INFO cinder.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Initiating service 3 cleanup Jul 03 12:40:56 devstack cinder-volume[86224]: INFO cinder.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Service 3 cleanup completed. Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG cinder.service [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Creating RPC server for service cinder-volume {{(pid=86224) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG cinder.service [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86224) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 12:40:56 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:40:56 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:40:56 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:40:56 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:40:57 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Jul 03 12:40:57 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.834s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:40:57 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-003ac5fb-4e2d-42e2-8f42-2b355b64911f None None] Driver post RPC initialization completed successfully. Jul 03 12:41:01 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:41:01 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:41:01 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:41:01 devstack cinder-volume[86224]: DEBUG cinder.volume.drivers.quobyte [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:41:01 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:41:01 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:41:01 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:41:01 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:41:02 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Jul 03 12:41:02 devstack cinder-volume[86224]: DEBUG oslo_concurrency.processutils [None req-440474ec-4727-428d-8aef-184af86d6afb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.651s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:41:02 devstack cinder-volume[86224]: DEBUG cinder.manager [None req-440474ec-4727-428d-8aef-184af86d6afb None None] Notifying Schedulers of capabilities ... {{(pid=86224) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:41:03 devstack cinder-volume[86012]: DEBUG dbcounter [-] [86012] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:41:04 devstack cinder-volume[86012]: INFO oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Caught SIGTERM, stopping children Jul 03 12:41:04 devstack cinder-volume[86012]: DEBUG oslo_concurrency.lockutils [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Acquiring lock "singleton_lock" {{(pid=86012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:41:04 devstack cinder-volume[86012]: DEBUG oslo_concurrency.lockutils [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Acquired lock "singleton_lock" {{(pid=86012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:41:04 devstack cinder-volume[86012]: DEBUG oslo_concurrency.lockutils [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Releasing lock "singleton_lock" {{(pid=86012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:41:04 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Stop services. {{(pid=86012) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 12:41:04 devstack cinder-volume[86012]: DEBUG oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Killing children. {{(pid=86012) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 12:41:04 devstack cinder-volume[86012]: INFO oslo_service.backend._eventlet.service [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Waiting on 1 children to exit Jul 03 12:41:07 devstack cinder-volume[86224]: DEBUG dbcounter [-] [86224] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86224) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:41:07 devstack cinder-volume[86224]: DEBUG dbcounter [-] [86224] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86224) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:41:09 devstack cinder-volume[86224]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 03 12:41:09 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Acquiring lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:41:09 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Acquired lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:41:09 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Releasing lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:41:09 devstack cinder-volume[86714]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 12:41:09 devstack cinder-volume[86714]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 12:41:09 devstack cinder-volume[86714]: we strongly recommend against using it for new projects. Jul 03 12:41:09 devstack cinder-volume[86714]: If you are already using Eventlet, we recommend migrating to a different Jul 03 12:41:09 devstack cinder-volume[86714]: framework. For more detail see Jul 03 12:41:09 devstack cinder-volume[86714]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 12:41:09 devstack cinder-volume[86714]: import eventlet # noqa Jul 03 12:41:09 devstack cinder-volume[86224]: WARNING amqp [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 12:41:09 devstack cinder-volume[86224]: WARNING amqp [None req-8801643b-819c-48d9-a279-40fe4ae1b833 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 12:41:12 devstack cinder-volume[86714]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 12:41:12 devstack cinder-volume[86714]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 12:41:12 devstack cinder-volume[86714]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 12:41:12 devstack cinder-volume[86714]: INFO dbcounter [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Registered counter for database cinder Jul 03 12:41:12 devstack cinder-volume[86714]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG dbcounter [-] [86714] Writer thread running {{(pid=86714) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 12:41:13 devstack cinder-volume[86714]: INFO cinder.rpc [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 12:41:13 devstack cinder-volume[86714]: INFO cinder.rpc [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:41:13 devstack cinder-volume[86714]: INFO cinder.volume.manager [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Determined volume DB was empty at startup. Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG cinder.volume.manager [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86714) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 12:41:13 devstack cinder-volume[86714]: WARNING stevedore.named [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 12:41:13 devstack cinder-volume[86714]: WARNING castellan.key_manager [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:41:13 devstack cinder-volume[86714]: WARNING cinder.keymgr.conf_key_mgr [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 12:41:13 devstack cinder-volume[86714]: INFO cinder.volume.manager [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_db.sqlalchemy.engines [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:41:13 devstack cinder-volume[86714]: INFO oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Starting 1 workers Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Started child 86966 {{(pid=86714) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Full set of CONF: {{(pid=86714) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] ******************************************************************************** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] Configuration options gathered from: {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] ================================================================================ {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] allow_availability_zone_fallback = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] allow_compression_on_image_upload = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] allowed_direct_url_schemes = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86966]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] api_rate_limit = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] auth_strategy = keystone {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_availability_zone = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_host = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_stats_polling_interval = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backup_api_class = cinder.backup.api.API {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backup_name_template = backup-%s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backup_use_same_host = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backup_use_temp_snapshot = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] chap_password = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] chap_username = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_internal_tenant_project_id = 834a85d156734f75a2abc87d335831da {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_internal_tenant_user_id = 7e2417fcc9f04edb8e0070a554014b54 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cluster = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] compression_format = gzip {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] compute_api_class = cinder.compute.nova.API {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] config_dir = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] config_source = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] control_exchange = openstack {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] debug = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] default_availability_zone = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] default_group_type = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] default_volume_type = QuobyteHD {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] disk_geometry = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] driver_client_cert = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] driver_client_cert_key = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] driver_data_namespace = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] driver_ssl_cert_path = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] driver_ssl_cert_verify = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] driver_use_ssl = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] enable_new_services = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] enable_unsupported_driver = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] enabled_backends = ['QuobyteHD'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] enforce_multipath_for_image_xfer = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] filter_function = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_api_insecure = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_api_ssl_compression = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_ca_certificates_file = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_catalog_info = image:glance:publicURL {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_num_retries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance_request_timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] goodness_function = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] graceful_shutdown_timeout = 5 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] group_api_class = cinder.group.api.API {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] host = devstack {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_compress_on_upload = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_conversion_address_space_limit = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_conversion_cpu_limit = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_conversion_disable = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_upload_use_cinder_backend = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_upload_use_internal_tenant = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_volume_cache_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_volume_cache_max_count = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] image_volume_cache_max_size_gb = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] init_host_max_objects_retrieval = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] instance_format = [instance: %(uuid)s] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] iscsi_target_flags = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] iscsi_write_cache = on {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] iser_helper = tgtadm {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] iser_ip_address = 192.168.122.245 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] iser_port = 3260 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_color = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_config_append = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_dir = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_file = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_options = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_rotate_interval = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_rotate_interval_type = days {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] log_rotation_type = none {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] max_age = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] max_logfile_count = 30 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] max_logfile_size_mb = 200 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] max_over_subscription_ratio = 20.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] message_reap_interval = 86400 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] message_ttl = 2592000 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] migration_create_volume_timeout_secs = 300 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] monkey_patch = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] monkey_patch_modules = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] my_ip = 192.168.122.245 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] no_snapshot_gb_quota = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] num_iser_scan_tries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] num_shell_tries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] num_volume_device_scan_tries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] nvmeof_conn_info_version = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] nvmet_ns_id = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] nvmet_port_id = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_max_limit = 1000 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_volume_ext_list = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_volume_listen_port = 8776 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_volume_use_ssl = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] osapi_volume_workers = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] per_volume_size_limit = -1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] periodic_fuzzy_delay = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] periodic_interval = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] public_endpoint = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] publish_errors = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_backup_gigabytes = 1000 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_backups = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_gigabytes = 1000 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_groups = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_snapshots = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86966) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] quota_volumes = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] rate_limit_burst = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] rate_limit_except_level = CRITICAL {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] rate_limit_interval = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] reinit_driver_count = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] replication_device = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] report_discard_supported = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] report_interval = 120 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] reservation_clean_interval = 86400 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] reservation_expire = 86400 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] reserved_image_namespaces = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] reserved_percentage = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] rpc_response_timeout = 120 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] run_external_periodic_tasks = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] scst_target_driver = iscsi {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] scst_target_iqn_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_down_time = 720 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] shell_completion = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] snapshot_name_template = snapshot-%s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] split_loggers = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] state_path = /opt/stack/data/cinder {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] storage_availability_zone = nova {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] storage_protocol = iSCSI {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] syslog_log_facility = LOG_USER {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] target_helper = lioadm {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] target_ip_address = 192.168.122.245 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] target_port = 3260 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] target_protocol = iscsi {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] target_secondary_ip_addresses = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] trace_flags = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] transport_url = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] until_refresh = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_chap_auth = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_default_quota_class = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_journal = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_json = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_multipath_for_image_xfer = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_stderr = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] use_syslog = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] verify_glance_signatures = enabled {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_api_class = cinder.volume.api.API {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_backend_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_clear = zero {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_clear_ionice = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_clear_size = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_copy_bps_limit = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_dd_blocksize = 1M {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_name_template = volume-%s {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_service_inithost_offload = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volume_usage_audit_period = month {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] zoning_mode = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_concurrency.disable_process_locking = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.auth_section = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.auth_type = password {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.auth_version = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.cache = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.include_service_catalog = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.insecure = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.interface = public {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_password = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcache_username = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.region_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.service_type = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.backend = dogpile.cache.null {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.backend_argument = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.backend_expiration_time = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.config_prefix = cache.oslo {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.debug_cache_backend = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.enable_retry_client = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.enable_socket_keepalive = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.expiration_time = 600 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.hashclient_retry_attempts = 2 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_dead_retry = 300 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_pool_maxsize = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_sasl_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.password = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.proxies = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.redis_db = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.redis_server = localhost:6379 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.retry_attempts = 2 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.retry_delay = 0.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.socket_keepalive_count = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.socket_keepalive_idle = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.socket_keepalive_interval = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.socket_timeout = 1.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.tls_allowed_ciphers = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.tls_cafile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.tls_certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.tls_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.tls_keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cache.username = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] coordination.backend_url = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.asyncio_connection = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.asyncio_slave_connection = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.backend = sqlalchemy {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.connection = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.connection_debug = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.connection_parameters = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.connection_recycle_time = 3600 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.connection_trace = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.db_inc_retry_interval = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.db_max_retries = 20 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.db_max_retry_interval = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.db_retry_interval = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.max_overflow = 50 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.max_pool_size = 5 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.max_retries = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.mysql_wsrep_sync_wait = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.pool_timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.retry_interval = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.slave_connection = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.sqlite_synchronous = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.synchronous_reader = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] database.use_db_reconnect = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.connection_string = messaging:// {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.es_doc_type = notification {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.es_scroll_size = 10000 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.es_scroll_time = 2m {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.filter_error_trace = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.hmac_keys = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.sentinel_service_name = mymaster {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.socket_timeout = 0.1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.trace_requests = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler.trace_sqlalchemy = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler_jaeger.process_tags = {} {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler_jaeger.service_name_prefix = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] profiler_otlp.service_name_prefix = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.enforce_new_defaults = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.enforce_scope = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.policy_default_rule = default {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.policy_file = policy.yaml {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.group = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.helper_command = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] privsep_osbrick.user = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.group = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.helper_command = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] cinder_sys_admin.user = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.auth_section = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.auth_type = password {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.cafile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.collect_timing = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.insecure = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.send_service_user_token = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.split_loggers = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] service_user.timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.auth_section = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.auth_type = password {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.collect_timing = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.insecure = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.region_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.split_loggers = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86966) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 12:41:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] glance.timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.backend_availability_zone = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.chap_password = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.chap_username = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.disk_geometry = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.driver_client_cert = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Running cmd (subprocess): mount.quobyte {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.driver_client_cert_key = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.driver_data_namespace = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.driver_use_ssl = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.extra_capabilities = {} {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.filter_function = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.goodness_function = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.iscsi_target_flags = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.iscsi_write_cache = on {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.iser_helper = tgtadm {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.iser_port = 3260 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_host = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_login = admin {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_mount_options = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_password = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_private_key = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_share_path = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.num_shell_tries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.quobyte_volume_url = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.replication_device = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.report_discard_supported = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.reserved_percentage = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.target_helper = tgtadm {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.target_port = 3260 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.target_protocol = iscsi {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.trace_flags = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.unique_fqdn_network = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.use_chap_auth = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_backend_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_clear = zero {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_clear_ionice = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_clear_size = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_reports.file_event_handler = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_reports.log_dir = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.backend_availability_zone = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.backend_host = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.chap_password = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.chap_username = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.chiscsi_conf = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.disk_geometry = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.driver_client_cert = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.driver_data_namespace = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.driver_use_ssl = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.extra_capabilities = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.filter_function = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.goodness_function = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.iser_helper = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.iser_ip_address = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.iser_port = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.iser_target_prefix = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_host = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_login = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_mount_options = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_password = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_private_key = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_share_path = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_ssh_port = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.num_shell_tries = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.nvmet_port_id = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack quobyte-client[86967]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 12:41:13 devstack quobyte-client[86967]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.replication_device = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.report_discard_supported = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.reserved_percentage = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.scst_target_driver = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.storage_protocol = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.target_helper = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.target_ip_address = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.target_port = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.target_prefix = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.target_protocol = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.trace_flags = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.use_chap_auth = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_clear = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_clear_size = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] QuobyteHD.volumes_dir = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_notifications.driver = [] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_notifications.retry = -1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] key_manager.fixed_key = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.barbican_api_version = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.barbican_endpoint = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.barbican_endpoint_type = public {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.barbican_region_name = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.cafile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.collect_timing = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.insecure = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.number_of_retries = 60 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.retry_delay = 1 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.send_service_user_token = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.split_loggers = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.verify_ssl = True {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican.verify_ssl_path = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.auth_section = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.auth_type = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.cafile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.certfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.collect_timing = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.insecure = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.keyfile = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.split_loggers = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] barbican_service_user.timeout = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.approle_role_id = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.approle_secret_id = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.kv_mountpoint = secret {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.kv_path = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.kv_version = 2 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.namespace = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.root_token_id = **** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.ssl_ca_crt_file = None {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.timeout = 60.0 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.use_ssl = False {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 12:41:13 devstack cinder-volume[86714]: DEBUG oslo_service.backend._eventlet.service [None req-4a4dd00e-242c-48b9-807f-67c74b2cf762 None None] ******************************************************************************** {{(pid=86714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 12:41:13 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:41:13 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:41:14 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:41:14 devstack cinder-volume[86966]: INFO cinder.volume.driver [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG cinder.volume.driver [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7511024475098, 'free_capacity_gb': 1775.7511024475098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG oslo_db.sqlalchemy.engines [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86966) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writer thread running {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG cinder.db.sqlalchemy.api [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Building query based on filter {{(pid=86966) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86966) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:41:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:41:14 devstack cinder-volume[86966]: INFO cinder.keymgr.migration [None req-b8cbce18-f110-4eee-9bfd-7112acd76862 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 12:41:14 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:41:14 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:41:15 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.622s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:41:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Driver initialization completed successfully. Jul 03 12:41:15 devstack cinder-volume[86966]: INFO cinder.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Initiating service 3 cleanup Jul 03 12:41:15 devstack cinder-volume[86966]: INFO cinder.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Service 3 cleanup completed. Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG cinder.service [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Creating RPC server for service cinder-volume {{(pid=86966) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG cinder.service [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86966) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 12:41:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:41:15 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:41:15 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:41:15 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Jul 03 12:41:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:41:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcaf8e4d-66ec-4c0f-b8d1-a494d997cc95 None None] Driver post RPC initialization completed successfully. Jul 03 12:41:23 devstack cinder-volume[86714]: DEBUG dbcounter [-] [86714] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86714) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:41:24 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:41:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Flow 'volume_create_manager' (eda30901-69f3-465c-adf8-aee5d354df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f16bdc9-ff93-4747-8a39-a644426ffaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f16bdc9-ff93-4747-8a39-a644426ffaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1921299603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2413c6-667e-4da6-8d8a-bcf236fe4fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17000554108469bb30da740b5fad608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:42:12Z,use_quota=True,user_id='9d4b8eca710f4c3383149b543131067f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1303da03-ed5c-438a-81bf-2d749bd49f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1303da03-ed5c-438a-81bf-2d749bd49f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369207a1-2068-4114-a004-040dea57a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369207a1-2068-4114-a004-040dea57a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2413c6-667e-4da6-8d8a-bcf236fe4fe3', 'volume_name': 'volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813cc6bb-30c9-4d28-9023-11c3774d88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813cc6bb-30c9-4d28-9023-11c3774d88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ada7f23-53f0-47af-90ca-6ec8c572f7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Volume 4a2413c6-667e-4da6-8d8a-bcf236fe4fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3', 'volume_size': 1} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1921299603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2413c6-667e-4da6-8d8a-bcf236fe4fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17000554108469bb30da740b5fad608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:42:12Z,use_quota=True,user_id='9d4b8eca710f4c3383149b543131067f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Creating volume 4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:42:12 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:42:12 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 1073741824 Jul 03 12:42:12 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:42:13 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Jul 03 12:42:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 1073741824" returned: 0 in 1.133s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:42:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:42:13 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 Jul 03 12:42:13 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" returned: 0 in 0.904s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:42:14 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ada7f23-53f0-47af-90ca-6ec8c572f7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d65ce11-8059-4e79-b138-9bd6f444de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Volume volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 (4a2413c6-667e-4da6-8d8a-bcf236fe4fe3): created successfully Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d65ce11-8059-4e79-b138-9bd6f444de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Flow 'volume_create_manager' (eda30901-69f3-465c-adf8-aee5d354df0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:42:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ec8fd877-50c6-4573-b57a-37b4830caace tempest-TaggedAttachmentsTest-1229992871 None] Created volume successfully. Jul 03 12:42:24 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:42:24 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Flow 'volume_create_manager' (25d12b02-a461-4eb3-8163-3c35da413af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef61f506-d383-4835-8170-98ff9cbc2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef61f506-d383-4835-8170-98ff9cbc2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-414045665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870b5c17-f4db-454b-a0eb-aff22065a506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01456f091784409b3064a900f6ba32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:42:29Z,use_quota=True,user_id='b45ecd3a9f5f406fb6a539c814c77051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c819a75a-f132-4285-9418-07744b8b0b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c819a75a-f132-4285-9418-07744b8b0b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482ad8a8-eca1-44e9-87b7-8be16f87cdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482ad8a8-eca1-44e9-87b7-8be16f87cdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870b5c17-f4db-454b-a0eb-aff22065a506', 'volume_name': 'volume-870b5c17-f4db-454b-a0eb-aff22065a506', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3470b716-39ca-4253-bdd4-16dc75d1055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3470b716-39ca-4253-bdd4-16dc75d1055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b932f3c3-af77-4599-8074-16c4333ec566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Volume 870b5c17-f4db-454b-a0eb-aff22065a506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870b5c17-f4db-454b-a0eb-aff22065a506', 'volume_size': 1} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-414045665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870b5c17-f4db-454b-a0eb-aff22065a506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01456f091784409b3064a900f6ba32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:42:29Z,use_quota=True,user_id='b45ecd3a9f5f406fb6a539c814c77051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Creating volume 870b5c17-f4db-454b-a0eb-aff22065a506 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:42:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:42:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:42:29 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 1073741824 Jul 03 12:42:29 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:42:31 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Jul 03 12:42:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 1073741824" returned: 0 in 2.094s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:42:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:42:31 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 Jul 03 12:42:31 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:42:33 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506" returned: 0 in 1.483s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] <== create_volume: return (3707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.711s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b932f3c3-af77-4599-8074-16c4333ec566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870b5c17-f4db-454b-a0eb-aff22065a506', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104922fd-7ee8-43e6-b814-76c8fcbec73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Volume volume-870b5c17-f4db-454b-a0eb-aff22065a506 (870b5c17-f4db-454b-a0eb-aff22065a506): created successfully Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104922fd-7ee8-43e6-b814-76c8fcbec73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Flow 'volume_create_manager' (25d12b02-a461-4eb3-8163-3c35da413af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:42:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-989f3883-9f79-42d4-9a0e-fa1a27953ac6 tempest-DeleteServersTestJSON-642486969 None] Created volume successfully. Jul 03 12:42:43 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:42:43 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:42:45 devstack cinder-volume[86966]: WARNING py.warnings [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 03 12:42:45 devstack cinder-volume[86966]: .first() Jul 03 12:42:45 devstack cinder-volume[86966]: Jul 03 12:42:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:45 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgndvnag8/privsep.sock'] Jul 03 12:42:45 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgndvnag8/privsep.sock Jul 03 12:42:45 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 12:42:47 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 12:42:48 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 12:42:49 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Jul 03 12:42:49 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Spawned new privsep daemon via rootwrap Jul 03 12:42:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Accepted privsep connection to /tmp/tmpgndvnag8/privsep.sock {{(pid=86966) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 12:42:49 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 12:42:49 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 12:42:49 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 12:42:49 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88134 Jul 03 12:42:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469d2cc-b5bb-430b-bc92-5b120e5c2914]: (2,) {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:42:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910a3fb-2bba-4360-97ef-634d30de5ab1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:42:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:42:49 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 Jul 03 12:42:49 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:42:50 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Jul 03 12:42:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506" returned: 0 in 1.281s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:42:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.940s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:42:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-870b5c17-f4db-454b-a0eb-aff22065a506', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97a405a2-84cc-4e34-b2a4-3f07041245d2', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:42:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ec9fbbd2-76ac-409c-a1ba-7782c8a5bea8 req-0b6cd88d-3dcf-4c0b-81fe-6112d8a627a8 tempest-DeleteServersTestJSON-642486969 None] attachment_update completed successfully. Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Flow 'volume_create_manager' (0a4b5f78-cc25-4132-8e34-782eef3fc765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ac7094-4b1b-4b84-a09b-da2211b96987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ac7094-4b1b-4b84-a09b-da2211b96987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1560126249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f416b2fb-b5ec-4200-b0ad-07b07e15505e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5b40c0196c4139815ec29c3bedf792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:42:57Z,use_quota=True,user_id='c6817d3b06704cb6b0241dbfcc4fec92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50bec8c-5ca3-4dba-b154-f1c7826d4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50bec8c-5ca3-4dba-b154-f1c7826d4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af89d0e8-4111-433a-ae87-46e5af344ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af89d0e8-4111-433a-ae87-46e5af344ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f416b2fb-b5ec-4200-b0ad-07b07e15505e', 'volume_name': 'volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaa1632-1163-4044-998d-06adbc56af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaa1632-1163-4044-998d-06adbc56af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fb31b6-11ee-4f3d-8d12-14639b423275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:42:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Volume f416b2fb-b5ec-4200-b0ad-07b07e15505e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e', 'volume_size': 1} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1560126249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f416b2fb-b5ec-4200-b0ad-07b07e15505e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5b40c0196c4139815ec29c3bedf792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:42:57Z,use_quota=True,user_id='c6817d3b06704cb6b0241dbfcc4fec92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Creating volume f416b2fb-b5ec-4200-b0ad-07b07e15505e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:42:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:42:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:42:58 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:42:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:42:58 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e 1073741824 Jul 03 12:42:58 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:00 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e 1073741824" returned: 0 in 2.724s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:00 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e Jul 03 12:43:00 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:43:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:01 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:43:01 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:02 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e" returned: 0 in 1.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] <== create_volume: return (4531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.544s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fb31b6-11ee-4f3d-8d12-14639b423275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c8e0cb-d4ea-43a5-bb8e-5bc129746fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:43:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Volume volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e (f416b2fb-b5ec-4200-b0ad-07b07e15505e): created successfully Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c8e0cb-d4ea-43a5-bb8e-5bc129746fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:43:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Flow 'volume_create_manager' (0a4b5f78-cc25-4132-8e34-782eef3fc765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:43:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9d3ff94e-17da-4e86-91f7-f96b8296fa9b tempest-ServerRescueNegativeTestJSON-363294019 None] Created volume successfully. Jul 03 12:43:03 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.622s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:43:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-68f20f88-02d9-49b7-b729-2d1ffc2b2561 req-25ebc241-4e03-4051-b88c-59be74b7d101 tempest-DeleteServersTestJSON-642486969 None] Terminate volume connection completed successfully. Jul 03 12:43:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-68f20f88-02d9-49b7-b729-2d1ffc2b2561 req-25ebc241-4e03-4051-b88c-59be74b7d101 tempest-DeleteServersTestJSON-642486969 None] Deleting attachment 97a405a2-84cc-4e34-b2a4-3f07041245d2. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:43:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Acquiring lock "cinder-870b5c17-f4db-454b-a0eb-aff22065a506-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:43:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Lock "cinder-870b5c17-f4db-454b-a0eb-aff22065a506-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:43:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Acquiring lock "cinder-quobyte-870b5c17-f4db-454b-a0eb-aff22065a506" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:43:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Lock "cinder-quobyte-870b5c17-f4db-454b-a0eb-aff22065a506" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:43:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ddcae9-4083-470e-b43e-cde10fc4c3e4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:43:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:08 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 Jul 03 12:43:08 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:09 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506" returned: 0 in 1.202s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:09 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506 Jul 03 12:43:09 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:10 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-870b5c17-f4db-454b-a0eb-aff22065a506" returned: 0 in 1.003s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Lock "cinder-quobyte-870b5c17-f4db-454b-a0eb-aff22065a506" released by "delete_volume" :: held 2.272s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:43:10 devstack cinder-volume[86966]: WARNING cinder.quota [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:43:10 devstack cinder-volume[86966]: WARNING cinder.quota [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Created reservations ['06890157-ccbd-4d8d-9e20-1aca572f2a71', '3a346b0c-740c-4382-86ce-dbafac0638b1', '1f1c9f7c-964f-454f-a5e7-d79800549526', '14efdb0f-9420-48f7-88d6-2733cef3359a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:11 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:43:11 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:12 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.939s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:43:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Deleted volume successfully. Jul 03 12:43:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5de29ec-36a5-49d3-930d-7def9f149184 tempest-DeleteServersTestJSON-642486969 None] Lock "cinder-870b5c17-f4db-454b-a0eb-aff22065a506-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:43:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:43:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:43:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Acquiring lock "cinder-f416b2fb-b5ec-4200-b0ad-07b07e15505e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:43:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "cinder-f416b2fb-b5ec-4200-b0ad-07b07e15505e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:43:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Acquiring lock "cinder-quobyte-f416b2fb-b5ec-4200-b0ad-07b07e15505e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:43:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "cinder-quobyte-f416b2fb-b5ec-4200-b0ad-07b07e15505e" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:43:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce580505-c279-4c91-9a30-121bfeb09363]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:42 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e Jul 03 12:43:42 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:43 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e" returned: 0 in 1.241s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:43 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e Jul 03 12:43:43 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:44 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f416b2fb-b5ec-4200-b0ad-07b07e15505e" returned: 0 in 1.054s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "cinder-quobyte-f416b2fb-b5ec-4200-b0ad-07b07e15505e" released by "delete_volume" :: held 2.347s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Created reservations ['bb881ec4-b807-46e7-a899-c5f0726aa650', 'b4c7698e-cab5-486c-98f3-72000b56fbfd', '4102dcf2-9659-4484-a0ef-8e774179027d', '8d593107-6296-47ae-ac69-48afc62d279c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:43:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:44 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:43:44 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:45 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.164s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:43:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Deleted volume successfully. Jul 03 12:43:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-978ba458-2bdc-415b-a7f9-9345d51a4699 tempest-ServerRescueNegativeTestJSON-363294019 None] Lock "cinder-f416b2fb-b5ec-4200-b0ad-07b07e15505e-delete_volume" released by "delete_volume" :: held 3.884s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:43:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:43:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:43:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:43:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ff439-0f9d-40df-9fc3-bd80ef5a9311]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:43:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:43:55 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 Jul 03 12:43:55 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:43:56 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Jul 03 12:43:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" returned: 0 in 1.055s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:43:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.078s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:43:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ede4bde1-5dd4-481d-81aa-d1fedd22214c', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:43:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-0dc0004c-17ca-4710-81ca-9b606d45c86b req-d04e0251-3207-4432-ab77-cfcca2c824cb tempest-TaggedAttachmentsTest-1229992871 None] attachment_update completed successfully. Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:01 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:44:01 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:02 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.748s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:44:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ca95837c-5c00-4379-9b1d-e72abcff31f8 req-023ce8d8-21a6-4a6c-91da-678fa1cbe2cf tempest-TaggedAttachmentsTest-1229992871 None] Terminate volume connection completed successfully. Jul 03 12:44:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ca95837c-5c00-4379-9b1d-e72abcff31f8 req-023ce8d8-21a6-4a6c-91da-678fa1cbe2cf tempest-TaggedAttachmentsTest-1229992871 None] Deleting attachment ede4bde1-5dd4-481d-81aa-d1fedd22214c. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:44:13 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:44:13 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Flow 'volume_create_manager' (48984dd7-5014-4779-8248-7c0bcfa7bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b43d65-86cb-4be6-8bc7-43bd8c943ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b43d65-86cb-4be6-8bc7-43bd8c943ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-15231060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9824fcde-e22b-4847-999b-694a00ebb043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd058c870374124a8d9bc437a39426d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:44:22Z,use_quota=True,user_id='73c5d7bb80824bc1a76b4d477f96c618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b182b0b-30f9-44c4-813d-d712a8168ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b182b0b-30f9-44c4-813d-d712a8168ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54ac23d-c7ed-4cf7-a2f7-593ca509b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54ac23d-c7ed-4cf7-a2f7-593ca509b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9824fcde-e22b-4847-999b-694a00ebb043', 'volume_name': 'volume-9824fcde-e22b-4847-999b-694a00ebb043', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a1540f-fe2f-4e35-8b58-d89991f47d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a1540f-fe2f-4e35-8b58-d89991f47d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47918a4e-6d0a-4eef-918f-f7d0bc7eed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:22 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Volume 9824fcde-e22b-4847-999b-694a00ebb043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9824fcde-e22b-4847-999b-694a00ebb043', 'volume_size': 1} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-15231060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9824fcde-e22b-4847-999b-694a00ebb043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd058c870374124a8d9bc437a39426d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:44:22Z,use_quota=True,user_id='73c5d7bb80824bc1a76b4d477f96c618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Creating volume 9824fcde-e22b-4847-999b-694a00ebb043 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:44:22 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:22 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 1073741824 Jul 03 12:44:22 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:23 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 1073741824" returned: 0 in 1.090s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:23 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 Jul 03 12:44:23 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:25 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043" returned: 0 in 1.207s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47918a4e-6d0a-4eef-918f-f7d0bc7eed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9824fcde-e22b-4847-999b-694a00ebb043', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c83ba5-113f-411f-bfcb-16ab7cd83318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Volume volume-9824fcde-e22b-4847-999b-694a00ebb043 (9824fcde-e22b-4847-999b-694a00ebb043): created successfully Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c83ba5-113f-411f-bfcb-16ab7cd83318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Flow 'volume_create_manager' (48984dd7-5014-4779-8248-7c0bcfa7bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:44:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-abe2de13-4ffb-4131-af69-3518b28ca682 tempest-VolumesAdminNegativeTest-1800697949 None] Created volume successfully. Jul 03 12:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Acquiring lock "cinder-9824fcde-e22b-4847-999b-694a00ebb043-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "cinder-9824fcde-e22b-4847-999b-694a00ebb043-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Acquiring lock "cinder-quobyte-9824fcde-e22b-4847-999b-694a00ebb043" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "cinder-quobyte-9824fcde-e22b-4847-999b-694a00ebb043" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:44:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d55df36-e2bf-48b0-b64f-91696b924bd9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:44:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:27 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 Jul 03 12:44:27 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:28 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043" returned: 0 in 1.140s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:28 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043 Jul 03 12:44:28 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:29 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9824fcde-e22b-4847-999b-694a00ebb043" returned: 0 in 1.202s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "cinder-quobyte-9824fcde-e22b-4847-999b-694a00ebb043" released by "delete_volume" :: held 2.405s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Created reservations ['ae68f823-1654-4c30-9505-af32a1035770', '056712af-5754-4e8b-a631-f2964abcda60', '104822d8-1285-4ec5-ad71-a533530cd41e', 'ca90447d-eb29-4893-87d5-9086c16c36df'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:29 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:44:29 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:30 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.113s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:44:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Deleted volume successfully. Jul 03 12:44:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0e29c056-4079-4644-8b14-876817259f01 tempest-VolumesAdminNegativeTest-1800697949 None] Lock "cinder-9824fcde-e22b-4847-999b-694a00ebb043-delete_volume" released by "delete_volume" :: held 3.936s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Acquiring lock "cinder-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Lock "cinder-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Acquiring lock "cinder-quobyte-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Lock "cinder-quobyte-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:44:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07216d9-426f-47e1-afad-05a51ac40f1a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:31 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 Jul 03 12:44:31 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Flow 'volume_create_manager' (b113b205-a78c-4242-981e-f33767f6b9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1158b93-05eb-4656-8863-fe8fe4f94244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1158b93-05eb-4656-8863-fe8fe4f94244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-754331713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d98358aecd34b2fbe4a9fa30925dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:44:32Z,use_quota=True,user_id='115621fdea0540e69d8b0b9360afea01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84de3229-65a3-43f9-a557-b5ab32553440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84de3229-65a3-43f9-a557-b5ab32553440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28624a52-6dcb-4d69-8a00-7d2bea5e9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28624a52-6dcb-4d69-8a00-7d2bea5e9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24', 'volume_name': 'volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a523218-cba7-4384-ab31-c8313ff2a159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a523218-cba7-4384-ab31-c8313ff2a159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ee8dfe-c419-4e0b-86fa-965b7713b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Volume 9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24', 'volume_size': 1} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-754331713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d98358aecd34b2fbe4a9fa30925dee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:44:32Z,use_quota=True,user_id='115621fdea0540e69d8b0b9360afea01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Creating volume 9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:44:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:32 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 1073741824 Jul 03 12:44:32 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:32 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" returned: 0 in 1.061s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:32 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3 Jul 03 12:44:32 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:33 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Lock "cinder-quobyte-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3" released by "delete_volume" :: held 1.896s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Created reservations ['d1250503-5b05-430b-8465-dcd7a76d810f', 'b528de42-6c5d-4c37-a9b8-b26bf4d12389', '9f82f2f9-8298-4eba-9848-b081f370be40', '91a328ed-acaa-4bd4-b66c-6f9ef58e38a7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:44:33 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 1073741824" returned: 0 in 1.227s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:44:33 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:44:33 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:33 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 Jul 03 12:44:33 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:44:34 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ee8dfe-c419-4e0b-86fa-965b7713b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3326ff-7fab-47d7-8021-9d9e661805ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:44:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Volume volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 (9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24): created successfully Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3326ff-7fab-47d7-8021-9d9e661805ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Flow 'volume_create_manager' (b113b205-a78c-4242-981e-f33767f6b9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:44:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2e6fb767-e50c-4b0b-815e-f938dd098497 tempest-AttachVolumeShelveTestJSON-149712191 None] Created volume successfully. Jul 03 12:44:34 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.037s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:44:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Deleted volume successfully. Jul 03 12:44:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91907e8a-9770-4402-a786-cd55e08da6bd tempest-TaggedAttachmentsTest-1229992871 None] Lock "cinder-4a2413c6-667e-4da6-8d8a-bcf236fe4fe3-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:44:44 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:44:44 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:DELETE=4,cinder:INSERT=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:44:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-8852ab84-e70a-4297-8769-02d19a8511a2 req-bf50f8bb-ae02-4859-80d7-c01d39196ddf tempest-AttachVolumeShelveTestJSON-149712191 None] No connector for attachment c3fa9c0b-cfa2-4a32-bcf5-be0a0053a405; skipping storage backend terminate_connection call. {{(pid=86966) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 12:44:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-8852ab84-e70a-4297-8769-02d19a8511a2 req-bf50f8bb-ae02-4859-80d7-c01d39196ddf tempest-AttachVolumeShelveTestJSON-149712191 None] Deleting attachment c3fa9c0b-cfa2-4a32-bcf5-be0a0053a405. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:01 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:45:01 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:02 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.022s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:45:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:45:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Flow 'volume_create_manager' (1c711ec6-f322-4679-97ed-84240842d221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf971f62-3bea-4f02-81a7-180da8773dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf971f62-3bea-4f02-81a7-180da8773dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-807450009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d996e12a-1144-4910-9c4a-467b48279a0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21f2878c5bc4aa792916c6eca3c0838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:07Z,use_quota=True,user_id='63841b11733046e890df67509465c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3754ad5b-c392-4deb-8507-b6bb6e7c3d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3754ad5b-c392-4deb-8507-b6bb6e7c3d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778f33ab-6249-4b27-8fd8-9c138aafaec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778f33ab-6249-4b27-8fd8-9c138aafaec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd996e12a-1144-4910-9c4a-467b48279a0b', 'volume_name': 'volume-d996e12a-1144-4910-9c4a-467b48279a0b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dee208a-b5a3-47a8-8936-0e5cbd6132af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dee208a-b5a3-47a8-8936-0e5cbd6132af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec18f82-a9be-4b1f-8f5a-81af377581dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Volume d996e12a-1144-4910-9c4a-467b48279a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d996e12a-1144-4910-9c4a-467b48279a0b', 'volume_size': 1} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-807450009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d996e12a-1144-4910-9c4a-467b48279a0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21f2878c5bc4aa792916c6eca3c0838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:07Z,use_quota=True,user_id='63841b11733046e890df67509465c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Creating volume d996e12a-1144-4910-9c4a-467b48279a0b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:45:07 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:07 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b 1073741824 Jul 03 12:45:07 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:08 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b 1073741824" returned: 0 in 0.937s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:08 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b Jul 03 12:45:08 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:09 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec18f82-a9be-4b1f-8f5a-81af377581dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d996e12a-1144-4910-9c4a-467b48279a0b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bbb52b-9e3b-4e82-b811-09201a7fe4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Volume volume-d996e12a-1144-4910-9c4a-467b48279a0b (d996e12a-1144-4910-9c4a-467b48279a0b): created successfully Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bbb52b-9e3b-4e82-b811-09201a7fe4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Flow 'volume_create_manager' (1c711ec6-f322-4679-97ed-84240842d221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a7583353-be18-4c83-93a4-e321db2cebb5 tempest-VolumesTestJSON-1273043761 None] Created volume successfully. Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Flow 'volume_create_manager' (705781f3-8195-431f-8bc8-22f37e5ff48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76594ca0-55c6-473d-9c24-8a46ccb3c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76594ca0-55c6-473d-9c24-8a46ccb3c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1767766468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f435363-b2b2-47fa-ab5f-8e6adba9226f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21f2878c5bc4aa792916c6eca3c0838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:10Z,use_quota=True,user_id='63841b11733046e890df67509465c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d31952-8253-45ac-bde9-28a47d24643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d31952-8253-45ac-bde9-28a47d24643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0d8b79-f94c-4be8-b588-76dabbb2b69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0d8b79-f94c-4be8-b588-76dabbb2b69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f435363-b2b2-47fa-ab5f-8e6adba9226f', 'volume_name': 'volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca9cd82-7b80-4b51-bf24-1616d3276636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca9cd82-7b80-4b51-bf24-1616d3276636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee75e680-233e-4e29-bf73-acc2123c7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Volume 2f435363-b2b2-47fa-ab5f-8e6adba9226f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f', 'volume_size': 1} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1767766468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f435363-b2b2-47fa-ab5f-8e6adba9226f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21f2878c5bc4aa792916c6eca3c0838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:10Z,use_quota=True,user_id='63841b11733046e890df67509465c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Creating volume 2f435363-b2b2-47fa-ab5f-8e6adba9226f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:45:10 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:10 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f 1073741824 Jul 03 12:45:10 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:11 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f 1073741824" returned: 0 in 0.932s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:11 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f Jul 03 12:45:11 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:11 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f" returned: 0 in 0.675s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee75e680-233e-4e29-bf73-acc2123c7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32edd54e-1482-40a3-bb58-52fa541e817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Volume volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f (2f435363-b2b2-47fa-ab5f-8e6adba9226f): created successfully Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32edd54e-1482-40a3-bb58-52fa541e817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Flow 'volume_create_manager' (705781f3-8195-431f-8bc8-22f37e5ff48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fa54b8d3-a353-4edc-afde-8d93fe3b0f26 tempest-VolumesTestJSON-1273043761 None] Created volume successfully. Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Flow 'volume_create_manager' (5e67393e-3eab-43ed-b3ac-ee650fb4cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7722d9a9-24fa-4848-a5be-ea3c7d5a3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7722d9a9-24fa-4848-a5be-ea3c7d5a3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-748204954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc529b93-36d7-49d8-accc-b93bb9c15f74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21f2878c5bc4aa792916c6eca3c0838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:13Z,use_quota=True,user_id='63841b11733046e890df67509465c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0917824c-2c09-458b-9f67-567c73c3c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0917824c-2c09-458b-9f67-567c73c3c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96042952-a8a2-4251-b5a9-4c49fb974e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96042952-a8a2-4251-b5a9-4c49fb974e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc529b93-36d7-49d8-accc-b93bb9c15f74', 'volume_name': 'volume-dc529b93-36d7-49d8-accc-b93bb9c15f74', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e674642-f1ec-44ca-92f0-f39e0598ac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e674642-f1ec-44ca-92f0-f39e0598ac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c0b727-d1e6-43ce-8dc0-b97895088c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Volume dc529b93-36d7-49d8-accc-b93bb9c15f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc529b93-36d7-49d8-accc-b93bb9c15f74', 'volume_size': 1} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-748204954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc529b93-36d7-49d8-accc-b93bb9c15f74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21f2878c5bc4aa792916c6eca3c0838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:13Z,use_quota=True,user_id='63841b11733046e890df67509465c768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Creating volume dc529b93-36d7-49d8-accc-b93bb9c15f74 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:45:12 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:12 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 1073741824 Jul 03 12:45:12 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:13 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 1073741824" returned: 0 in 1.134s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:14 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 Jul 03 12:45:14 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:15 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74" returned: 0 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c0b727-d1e6-43ce-8dc0-b97895088c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc529b93-36d7-49d8-accc-b93bb9c15f74', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea4c8b-d0d7-4b4e-b2d7-c6b1d10e4120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Volume volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 (dc529b93-36d7-49d8-accc-b93bb9c15f74): created successfully Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea4c8b-d0d7-4b4e-b2d7-c6b1d10e4120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Flow 'volume_create_manager' (5e67393e-3eab-43ed-b3ac-ee650fb4cae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-403a7d1d-43a8-46cd-8c74-7454767daa70 tempest-VolumesTestJSON-1273043761 None] Created volume successfully. Jul 03 12:45:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "cinder-dc529b93-36d7-49d8-accc-b93bb9c15f74-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-dc529b93-36d7-49d8-accc-b93bb9c15f74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "cinder-quobyte-dc529b93-36d7-49d8-accc-b93bb9c15f74" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-quobyte-dc529b93-36d7-49d8-accc-b93bb9c15f74" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3076cb03-29b1-4e4f-bf0e-17873eeead43]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:17 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 Jul 03 12:45:17 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:18 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:18 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74 Jul 03 12:45:18 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:18 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dc529b93-36d7-49d8-accc-b93bb9c15f74" returned: 0 in 0.755s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-quobyte-dc529b93-36d7-49d8-accc-b93bb9c15f74" released by "delete_volume" :: held 1.664s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Created reservations ['a1312c56-c956-4474-8c2a-3b37737b9115', '71233d39-202e-485e-866e-35072c6ac968', '1f4f7c6e-cc20-45c1-a7f2-03d37e3c8152', '9015657c-8551-4c81-88b5-ec4b1c6d7aae'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:19 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:45:19 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "cinder-2f435363-b2b2-47fa-ab5f-8e6adba9226f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-2f435363-b2b2-47fa-ab5f-8e6adba9226f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "cinder-quobyte-2f435363-b2b2-47fa-ab5f-8e6adba9226f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-quobyte-2f435363-b2b2-47fa-ab5f-8e6adba9226f" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce90add1-8114-445c-a9d4-5dc24449829a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:19 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f Jul 03 12:45:19 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:19 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:19 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:45:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Deleted volume successfully. Jul 03 12:45:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3785b0f8-286e-41f7-ad6e-5fb5d07f3d71 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-dc529b93-36d7-49d8-accc-b93bb9c15f74-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:20 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f" returned: 0 in 0.841s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:20 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f Jul 03 12:45:20 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Flow 'volume_create_manager' (55c58bf1-ecf8-49b5-a922-47a063b00496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd10694-abcd-4538-ad05-bca7e043fe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd10694-abcd-4538-ad05-bca7e043fe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-509379312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cc4e2b-08af-43c7-96f7-8abf958d892b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43811ae5b5c4bcd8be311fc92b10f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:21Z,use_quota=True,user_id='70a46878012745b9af28f96926154bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dec9c42-4c26-4cfc-96e1-9e345cf30963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dec9c42-4c26-4cfc-96e1-9e345cf30963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3d2ff0-41e7-4ec4-b6c3-fb5cdcf95ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3d2ff0-41e7-4ec4-b6c3-fb5cdcf95ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9cc4e2b-08af-43c7-96f7-8abf958d892b', 'volume_name': 'volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bff15e7-e622-4c93-801a-8d9936758825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bff15e7-e622-4c93-801a-8d9936758825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f875d6bb-2ea7-47eb-b6f5-e60c382d2164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Volume c9cc4e2b-08af-43c7-96f7-8abf958d892b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b', 'volume_size': 1} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-509379312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cc4e2b-08af-43c7-96f7-8abf958d892b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43811ae5b5c4bcd8be311fc92b10f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:21Z,use_quota=True,user_id='70a46878012745b9af28f96926154bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Creating volume c9cc4e2b-08af-43c7-96f7-8abf958d892b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:45:21 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:21 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b 1073741824 Jul 03 12:45:21 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:21 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2f435363-b2b2-47fa-ab5f-8e6adba9226f" returned: 0 in 0.724s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-quobyte-2f435363-b2b2-47fa-ab5f-8e6adba9226f" released by "delete_volume" :: held 1.605s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Created reservations ['08fc9bf4-33eb-4184-9dab-871ce6121254', '5c53abae-228d-4c3b-aa09-de1b674ce6fc', 'e6201abf-68e5-4b0b-ad3f-3a63f4fbb997', '2373c7ff-7315-4a11-b617-f653555aacb3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:21 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:45:21 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "cinder-d996e12a-1144-4910-9c4a-467b48279a0b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-d996e12a-1144-4910-9c4a-467b48279a0b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "cinder-quobyte-d996e12a-1144-4910-9c4a-467b48279a0b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-quobyte-d996e12a-1144-4910-9c4a-467b48279a0b" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df53f49-35bf-4d37-b0ec-246ff83aaadd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:22 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.113s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:45:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Deleted volume successfully. Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89f75a4d-a639-4af4-a84e-41a912336335 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-2f435363-b2b2-47fa-ab5f-8e6adba9226f-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:22 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b 1073741824" returned: 0 in 1.437s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:22 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b Jul 03 12:45:22 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:22 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b Jul 03 12:45:22 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:24 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b" returned: 0 in 1.846s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:24 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b Jul 03 12:45:24 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:24 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b" returned: 0 in 1.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] <== create_volume: return (3313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.322s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f875d6bb-2ea7-47eb-b6f5-e60c382d2164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4656ae3-f06b-41d9-86d7-928ac3fb0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Volume volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b (c9cc4e2b-08af-43c7-96f7-8abf958d892b): created successfully Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4656ae3-f06b-41d9-86d7-928ac3fb0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Flow 'volume_create_manager' (55c58bf1-ecf8-49b5-a922-47a063b00496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f83bc7d7-3ec7-41bf-835b-d626eded298a tempest-AttachVolumeNegativeTest-29985512 None] Created volume successfully. Jul 03 12:45:25 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d996e12a-1144-4910-9c4a-467b48279a0b" returned: 0 in 1.713s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-quobyte-d996e12a-1144-4910-9c4a-467b48279a0b" released by "delete_volume" :: held 3.717s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Created reservations ['561a9e92-05d6-422d-abea-b44408d7f3e0', 'edf51643-318d-4329-9b9c-2d1bfcbbb9de', '07fbedb6-f4cd-449b-9d40-a5b91688356b', '8f170a50-8213-4251-a41e-d695b83b3715'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:26 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:45:26 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:27 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.156s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:27 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:45:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Deleted volume successfully. Jul 03 12:45:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-50ba7d67-6da7-48f5-ac6b-e029e2a530f9 tempest-VolumesTestJSON-1273043761 None] Lock "cinder-d996e12a-1144-4910-9c4a-467b48279a0b-delete_volume" released by "delete_volume" :: held 5.460s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aea718c-d30b-4bb8-bed7-610746c097a7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:30 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b Jul 03 12:45:30 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:31 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b" returned: 0 in 1.345s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.392s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48490b12-c79a-4a72-9f81-978ab445a9e7', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:45:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-7849a729-8707-4546-9198-fb81dc4c2cd3 req-392cc096-2940-48a8-a092-866a5e9ce526 tempest-AttachVolumeNegativeTest-29985512 None] attachment_update completed successfully. Jul 03 12:45:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ad7a6991-1e6e-44e2-9dea-46a036e90a97 tempest-GroupsV314Test-1511554916 None] Group tempest-GroupsV314Test-Group-1423993870: creating Jul 03 12:45:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ad7a6991-1e6e-44e2-9dea-46a036e90a97 tempest-GroupsV314Test-1511554916 None] Group tempest-GroupsV314Test-Group-1423993870: created successfully Jul 03 12:45:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ad7a6991-1e6e-44e2-9dea-46a036e90a97 tempest-GroupsV314Test-1511554916 None] Create group completed successfully. Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Flow 'volume_create_manager' (d8c0b10c-542f-4b3e-9836-ef0765478102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84c0c3-77ef-4597-a8cb-7571e624f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84c0c3-77ef-4597-a8cb-7571e624f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1170217331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48a50dbe-affd-47a9-9031-87d4272c0223,host='devstack@QuobyteHD#QuobyteHD',id=765e2865-d95a-4da8-a7d1-fb7d9b7299be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed8b9b03f748b1bd571378487d16e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:35Z,use_quota=True,user_id='75e881975c5045c8be0cbfbf9c88e720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d45a772-e664-44d8-bd8c-d6b03fe4aff9),volume_type_id=2d45a772-e664-44d8-bd8c-d6b03fe4aff9)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af287a52-99a7-4b9c-8006-c0215320855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af287a52-99a7-4b9c-8006-c0215320855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbe6587-e44f-482c-8694-6e9efea37d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbe6587-e44f-482c-8694-6e9efea37d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765e2865-d95a-4da8-a7d1-fb7d9b7299be', 'volume_name': 'volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8fa48f-bbd9-4dd9-a672-9220358c31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8fa48f-bbd9-4dd9-a672-9220358c31d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8781296f-a352-4140-9042-74cc94cf5e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Volume 765e2865-d95a-4da8-a7d1-fb7d9b7299be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be', 'volume_size': 1} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48a50dbe-affd-47a9-9031-87d4272c0223,created_at=2026-07-03T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1170217331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48a50dbe-affd-47a9-9031-87d4272c0223,host='devstack@QuobyteHD#QuobyteHD',id=765e2865-d95a-4da8-a7d1-fb7d9b7299be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed8b9b03f748b1bd571378487d16e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:35Z,use_quota=True,user_id='75e881975c5045c8be0cbfbf9c88e720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d45a772-e664-44d8-bd8c-d6b03fe4aff9),volume_type_id=2d45a772-e664-44d8-bd8c-d6b03fe4aff9)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Creating volume 765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:45:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:35 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be 1073741824 Jul 03 12:45:35 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:36 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be 1073741824" returned: 0 in 1.051s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:36 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:45:36 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 1.042s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:37 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8781296f-a352-4140-9042-74cc94cf5e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e071371-00ad-47fc-9e73-6198c18b117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Volume volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be (765e2865-d95a-4da8-a7d1-fb7d9b7299be): created successfully Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e071371-00ad-47fc-9e73-6198c18b117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Flow 'volume_create_manager' (d8c0b10c-542f-4b3e-9836-ef0765478102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-896bef5c-4253-4333-a12d-4b7508372f4a tempest-GroupsV314Test-1511554916 None] Created volume successfully. Jul 03 12:45:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Cloning volume 765e2865-d95a-4da8-a7d1-fb7d9b7299be to volume 98e75a28-3b15-4ea3-a513-9760e1208050 Jul 03 12:45:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Creating offline snapshot 50dac4e4-e848-4e3d-a76b-1d3d4ff6275d of volume 765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:45:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1880d9c-f15e-4256-a923-f232cbcd91a9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:39 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:45:39 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:40 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 1.161s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:40 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d 1G Jul 03 12:45:40 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:41 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d 1G" returned: 0 in 1.236s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:41 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d Jul 03 12:45:41 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:42 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:42 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:45:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:42 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d Jul 03 12:45:42 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:43 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" returned: 0 in 0.659s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:43 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info Jul 03 12:45:43 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:43 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info" returned: 0 in 0.673s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:43 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:43 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info Jul 03 12:45:43 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:44 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.info" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Acquiring lock "cinder-quobyte-98e75a28-3b15-4ea3-a513-9760e1208050" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-98e75a28-3b15-4ea3-a513-9760e1208050" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] snapshot: 50dac4e4-e848-4e3d-a76b-1d3d4ff6275d, volume: 98e75a28-3b15-4ea3-a513-9760e1208050, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd3182-b701-4852-9030-ed8db3361112]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:44 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d Jul 03 12:45:44 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:45 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:45:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d7fe2c-c426-477e-9597-38e0b309d90b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:45 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:45:45 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:46 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:46 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:46 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 Jul 03 12:45:46 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=32,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:45:53 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Flow 'volume_create_manager' (8e613e20-4c3b-4a9d-948b-8fcc67fea30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6ff73a-0428-4985-a524-cfbfac0ef025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050" returned: 0 in 7.373s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6ff73a-0428-4985-a524-cfbfac0ef025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-270721425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c14e27d-553e-4aca-9c41-0164f27d6394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96ee61b1ba4398bd0148480c679421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:54Z,use_quota=True,user_id='53f63ecd5e2f4edea52b909d855f3b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e616bfe0-1c4c-4c50-aae1-9a44a4d46f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e616bfe0-1c4c-4c50-aae1-9a44a4d46f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2949cd-9e57-4e8b-9a35-f4b9be43bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2949cd-9e57-4e8b-9a35-f4b9be43bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c14e27d-553e-4aca-9c41-0164f27d6394', 'volume_name': 'volume-8c14e27d-553e-4aca-9c41-0164f27d6394', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b29081c-867c-4f92-8a4f-7813bb60efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b29081c-867c-4f92-8a4f-7813bb60efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f756c90-bac8-49fe-9dbd-4e4aa7314b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:45:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Volume 8c14e27d-553e-4aca-9c41-0164f27d6394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c14e27d-553e-4aca-9c41-0164f27d6394', 'volume_size': 1} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac106567-91f1-47ac-89fa-2bd3c041e971]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:53 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:45:53 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:54 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 1.127s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:54 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:45:54 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Converted 1024.00 MB image at 138.87 MB/s Jul 03 12:45:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:54 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 Jul 03 12:45:54 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:55 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050" returned: 0 in 0.734s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-98e75a28-3b15-4ea3-a513-9760e1208050" released by "_copy_volume_from_snapshot" :: held 11.099s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Acquiring lock "cinder-quobyte-50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Deleting offline snapshot 50dac4e4-e848-4e3d-a76b-1d3d4ff6275d of volume 765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] snapshot_file for this snap is: volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[63073c6e-3d2b-4afe-aff6-353a90d915e7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:55 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d Jul 03 12:45:55 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:56 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" returned: 0 in 1.231s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:45:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[937ae75f-55c1-4af4-8fa2-1fc7c71a4593]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:57 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:45:57 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:57 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 1.036s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:58 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d Jul 03 12:45:58 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:59 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" returned: 0 in 1.041s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:59 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d Jul 03 12:45:59 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:45:59 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be.50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" returned: 0 in 0.767s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-50dac4e4-e848-4e3d-a76b-1d3d4ff6275d" released by "_delete_snapshot" :: held 4.236s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.777s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.197s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-270721425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c14e27d-553e-4aca-9c41-0164f27d6394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96ee61b1ba4398bd0148480c679421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:45:54Z,use_quota=True,user_id='53f63ecd5e2f4edea52b909d855f3b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Creating volume 8c14e27d-553e-4aca-9c41-0164f27d6394 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:45:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:45:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:45:59 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 1073741824 Jul 03 12:45:59 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e063b97f-5f5a-41cc-b22e-853ebc573d58 tempest-GroupsV314Test-1511554916 None] Create group from source-group-48a50dbe-affd-47a9-9031-87d4272c0223 completed successfully. Jul 03 12:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Acquiring lock "cinder-quobyte-98e75a28-3b15-4ea3-a513-9760e1208050" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-98e75a28-3b15-4ea3-a513-9760e1208050" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[68312e39-c9c1-4050-8794-fabc812d429d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:01 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 Jul 03 12:46:01 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:01 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 1073741824" returned: 0 in 1.462s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:01 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 Jul 03 12:46:01 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:01 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:46:01 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:02 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050" returned: 0 in 1.269s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:02 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:02 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050 Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] <== create_volume: return (2518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.525s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:02 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f756c90-bac8-49fe-9dbd-4e4aa7314b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c14e27d-553e-4aca-9c41-0164f27d6394', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7a93dc-8ee4-4118-87d1-542f9f2dc2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Volume volume-8c14e27d-553e-4aca-9c41-0164f27d6394 (8c14e27d-553e-4aca-9c41-0164f27d6394): created successfully Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7a93dc-8ee4-4118-87d1-542f9f2dc2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Flow 'volume_create_manager' (8e613e20-4c3b-4a9d-948b-8fcc67fea30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:46:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6cd829aa-ab23-4623-9eb7-cbd51e0afc2d tempest-ServerActionsTestOtherA-31762922 None] Created volume successfully. Jul 03 12:46:03 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.208s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:46:03 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98e75a28-3b15-4ea3-a513-9760e1208050" returned: 0 in 1.009s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-98e75a28-3b15-4ea3-a513-9760e1208050" released by "delete_volume" :: held 2.396s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Created reservations ['46939172-fd6f-4af0-b9d2-69cdeaa2cf08'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:03 devstack cinder-volume[86966]: WARNING cinder.quota [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-607684963 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-607684963, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:46:03 devstack cinder-volume[86966]: WARNING cinder.quota [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-607684963 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-607684963, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Created reservations ['1b1603d6-995c-4e3b-92cf-72ff3ef2f6d7', 'e85911f1-cadd-4880-9528-cc4ceed5d92a', 'c67e2a84-a682-489c-9871-2e9dd2fb73fc', '1ad1d70e-df40-46dc-ad42-dbd6da0aa1dc'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:03 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:46:03 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Acquiring lock "cinder-quobyte-765e2865-d95a-4da8-a7d1-fb7d9b7299be" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-765e2865-d95a-4da8-a7d1-fb7d9b7299be" acquired by "delete_volume" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:05 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.528s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:46:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a3434-16fa-4bb5-a6a2-f6d0ade0b187]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8415b600-0976-4031-b947-8d05e4abed87 tempest-GroupsV314Test-1511554916 None] Delete group completed successfully. Jul 03 12:46:05 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:46:05 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:06 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 1.285s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:06 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be Jul 03 12:46:06 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:07 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-765e2865-d95a-4da8-a7d1-fb7d9b7299be" returned: 0 in 1.094s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Lock "cinder-quobyte-765e2865-d95a-4da8-a7d1-fb7d9b7299be" released by "delete_volume" :: held 2.512s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Created reservations ['055d0a38-58ac-4ff4-a18a-38019dbc9c5b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Created reservations ['c6bbea45-1769-4276-bb43-758863a9b39a', 'cfb238c2-39f3-4f11-afa1-26b56f709045', '8d0c3cd8-d728-4ce8-97ea-2a37d8f9374e', 'af84dcca-4a52-43a1-ad7c-60299f67048c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:08 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:46:08 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:09 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.075s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:46:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d4b4f4e0-8e74-41e1-9075-a85a36806e98 tempest-GroupsV314Test-1511554916 None] Delete group completed successfully. Jul 03 12:46:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Acquiring lock "cinder-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "cinder-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Acquiring lock "cinder-quobyte-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "cinder-quobyte-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a814480-f4ef-4d8a-8e02-a3ce7934e4fa]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:15 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 Jul 03 12:46:15 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:16 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24" returned: 0 in 1.409s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:16 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24 Jul 03 12:46:16 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:17 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24" returned: 0 in 1.082s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "cinder-quobyte-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24" released by "delete_volume" :: held 2.580s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Created reservations ['93163619-4295-470b-bbb4-3aea4f3d294b', 'd63c8c1f-99f9-4527-b8c9-182c87b84f59', 'e144e7b8-b7f0-4ad4-a51d-287284980a36', '267fd640-b8fb-49d4-b092-c8e3ca9fb1d0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:18 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:46:18 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:19 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.300s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:19 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:46:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Deleted volume successfully. Jul 03 12:46:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20b475c-ee85-4898-95b3-0d134d11d16b tempest-AttachVolumeShelveTestJSON-149712191 None] Lock "cinder-9f3cb9c1-33e4-4230-8acf-e22b4f0c5e24-delete_volume" released by "delete_volume" :: held 4.262s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=30,cinder:UPDATE=35,cinder:INSERT=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:46:29 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=36,cinder:SELECT=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:46:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-06e12113-9d22-44fe-a253-ff1355e4df11 tempest-GroupSnapshotsTest-1594135489 None] Group tempest-GroupSnapshotsTest-Group-1308047243: creating Jul 03 12:46:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-06e12113-9d22-44fe-a253-ff1355e4df11 tempest-GroupSnapshotsTest-1594135489 None] Group tempest-GroupSnapshotsTest-Group-1308047243: created successfully Jul 03 12:46:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-06e12113-9d22-44fe-a253-ff1355e4df11 tempest-GroupSnapshotsTest-1594135489 None] Create group completed successfully. Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Flow 'volume_create_manager' (c9eacdcd-0d94-49be-9e63-d9c2811c2505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d342db8-7098-46e1-ac04-9719898997b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d342db8-7098-46e1-ac04-9719898997b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1770998716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c16f91-6e9e-49ac-9227-47bf180ba28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b269966a8409415db43dbbc666182de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:46:33Z,use_quota=True,user_id='0f8095757c76448c96d1052d0f779daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0461bee9-5ede-41d5-8e03-fe7f0495031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0461bee9-5ede-41d5-8e03-fe7f0495031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc5b50b-6bcf-43b8-ae88-3d757f57cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc5b50b-6bcf-43b8-ae88-3d757f57cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c16f91-6e9e-49ac-9227-47bf180ba28e', 'volume_name': 'volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfafba6-0afc-49dd-969b-2faef7b86155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfafba6-0afc-49dd-969b-2faef7b86155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a95160-9171-4fd1-b1bb-acb941ac254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Volume b6c16f91-6e9e-49ac-9227-47bf180ba28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e', 'volume_size': 1} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1770998716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c16f91-6e9e-49ac-9227-47bf180ba28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b269966a8409415db43dbbc666182de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:46:33Z,use_quota=True,user_id='0f8095757c76448c96d1052d0f779daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Creating volume b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:46:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:32 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e 1073741824 Jul 03 12:46:32 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (ff9e5bed-5f02-47eb-b332-8a0312d08c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb8b187-5a41-4f2d-ad9d-33e90c3f6787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb8b187-5a41-4f2d-ad9d-33e90c3f6787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245323250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c0eb373-48cf-45e4-b6e2-1adaf8277a50,host='devstack@QuobyteHD#QuobyteHD',id=1a239ae6-2db8-47d1-aecd-0c3a102e058c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:46:33Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(845fefc6-4bd0-44d9-a422-db80e0a2ba85),volume_type_id=845fefc6-4bd0-44d9-a422-db80e0a2ba85)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9175f520-d6c2-44b3-bc2f-c409ee5811ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9175f520-d6c2-44b3-bc2f-c409ee5811ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c375b92a-aa23-406b-bc20-61bc1d7eaf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c375b92a-aa23-406b-bc20-61bc1d7eaf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a239ae6-2db8-47d1-aecd-0c3a102e058c', 'volume_name': 'volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6c3de6-4b7d-434a-a5af-33c5b7bd1f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6c3de6-4b7d-434a-a5af-33c5b7bd1f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d641d7-1d98-42fc-a80a-c45e44e40268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Volume 1a239ae6-2db8-47d1-aecd-0c3a102e058c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c', 'volume_size': 1} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b7868d9d-5c91-4d25-93d5-1f495a6f0456 req-6bc0be11-ec36-4438-8f9f-c4b24a8a6e5c tempest-AttachVolumeNegativeTest-29985512 None] Terminate volume connection completed successfully. Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b7868d9d-5c91-4d25-93d5-1f495a6f0456 req-6bc0be11-ec36-4438-8f9f-c4b24a8a6e5c tempest-AttachVolumeNegativeTest-29985512 None] Deleting attachment 48490b12-c79a-4a72-9f81-978ab445a9e7. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:46:33 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e 1073741824" returned: 0 in 0.948s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:33 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e Jul 03 12:46:33 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:34 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e" returned: 0 in 0.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c0eb373-48cf-45e4-b6e2-1adaf8277a50,created_at=2026-07-03T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245323250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c0eb373-48cf-45e4-b6e2-1adaf8277a50,host='devstack@QuobyteHD#QuobyteHD',id=1a239ae6-2db8-47d1-aecd-0c3a102e058c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:46:33Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(845fefc6-4bd0-44d9-a422-db80e0a2ba85),volume_type_id=845fefc6-4bd0-44d9-a422-db80e0a2ba85)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Creating volume 1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:46:34 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:34 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c 1073741824 Jul 03 12:46:34 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a95160-9171-4fd1-b1bb-acb941ac254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2be285-36f1-406b-8730-de6d524cc031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Volume volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e (b6c16f91-6e9e-49ac-9227-47bf180ba28e): created successfully Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2be285-36f1-406b-8730-de6d524cc031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Flow 'volume_create_manager' (c9eacdcd-0d94-49be-9e63-d9c2811c2505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:46:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dc8e0d85-7368-4217-8eec-160e34b1d09a tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Created volume successfully. Jul 03 12:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:35 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c 1073741824" returned: 0 in 1.144s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:35 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:46:35 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:36 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 0.890s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.384s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Creating offline snapshot 9929f0da-441e-49ad-8bfc-5edebdd003ec of volume b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d641d7-1d98-42fc-a80a-c45e44e40268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd600219-18ad-4a58-bd81-47f8dd6c9b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f01d06-aebf-40fc-ad51-0837aa4fc220]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Volume volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c (1a239ae6-2db8-47d1-aecd-0c3a102e058c): created successfully Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd600219-18ad-4a58-bd81-47f8dd6c9b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (ff9e5bed-5f02-47eb-b332-8a0312d08c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:46:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7bf1c935-bb2a-470c-8c08-39c3c59c0fd2 tempest-GroupSnapshotsTest-1594135489 None] Created volume successfully. Jul 03 12:46:37 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e Jul 03 12:46:37 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:37 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e" returned: 0 in 1.138s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:38 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec 1G Jul 03 12:46:38 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] GroupSnapshot 5934b108-7eb7-41a6-908a-f2db2b3527d7: creating. Jul 03 12:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Group snapshot 5934b108-7eb7-41a6-908a-f2db2b3527d7: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 12:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:39 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec 1G" returned: 0 in 1.272s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:39 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec Jul 03 12:46:39 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:40 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:40 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec is being set with open permissions: ugo+rw Jul 03 12:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:40 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec Jul 03 12:46:40 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:40 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec" returned: 0 in 0.662s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:40 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info Jul 03 12:46:40 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:41 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:41 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info is being set with open permissions: ugo+rw Jul 03 12:46:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:41 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info Jul 03 12:46:41 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:42 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.info" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.483s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.812s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Creating offline snapshot ea0a68c3-e85f-4c79-bef3-2e9131afa514 of volume 1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2549be3-8acc-4621-833d-91bb5e5e556c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-788845c6-4e7e-4e30-a8f2-bc07fa64090f tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Create snapshot completed successfully Jul 03 12:46:42 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:46:42 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:43 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 0.874s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:43 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 1G Jul 03 12:46:43 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "cinder-9929f0da-441e-49ad-8bfc-5edebdd003ec-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-9929f0da-441e-49ad-8bfc-5edebdd003ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "cinder-quobyte-b6c16f91-6e9e-49ac-9227-47bf180ba28e" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-quobyte-b6c16f91-6e9e-49ac-9227-47bf180ba28e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "cinder-quobyte-9929f0da-441e-49ad-8bfc-5edebdd003ec" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-quobyte-9929f0da-441e-49ad-8bfc-5edebdd003ec" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Deleting offline snapshot 9929f0da-441e-49ad-8bfc-5edebdd003ec of volume b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] snapshot_file for this snap is: volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f055d33-1633-44ae-be3e-41ba4d473440]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:43 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec Jul 03 12:46:43 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:44 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 1G" returned: 0 in 1.024s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:44 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 Jul 03 12:46:44 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:44 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec" returned: 0 in 1.002s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:46:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e124de-9e9f-49c5-a61a-935726f032d1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:44 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e Jul 03 12:46:44 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:45 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:45 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:45 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 Jul 03 12:46:45 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:45 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e" returned: 0 in 0.940s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:45 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec Jul 03 12:46:45 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:45 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514" returned: 0 in 0.833s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:45 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info Jul 03 12:46:45 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:46 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:46 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec Jul 03 12:46:46 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:46 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:46 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:46 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info Jul 03 12:46:46 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:47 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e.9929f0da-441e-49ad-8bfc-5edebdd003ec" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-quobyte-9929f0da-441e-49ad-8bfc-5edebdd003ec" released by "_delete_snapshot" :: held 3.797s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-quobyte-b6c16f91-6e9e-49ac-9227-47bf180ba28e" released by "delete_snapshot" :: held 3.820s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:47 devstack cinder-volume[86966]: WARNING cinder.quota [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Created reservations ['7478f51f-4e80-41b5-a454-9a356930496a', 'd942c181-af56-4c65-b30d-2e72951102fc', '38a4e5cf-d3e2-45c6-ad82-f5cefb2aace3', 'c5b33cea-c531-4f8c-88ea-d213d0a71407'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Delete snapshot completed successfully. Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bce4a237-a61e-493c-bbbf-f362ddba3c22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-9929f0da-441e-49ad-8bfc-5edebdd003ec-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:47 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.info" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.297s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.705s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058a7c0-3dcc-4f41-a1ff-9409c4abdd82]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "cinder-b6c16f91-6e9e-49ac-9227-47bf180ba28e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-b6c16f91-6e9e-49ac-9227-47bf180ba28e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:47 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 Jul 03 12:46:47 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eabc0463-e2a2-4406-87e2-c681b81d1540 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 5934b108-7eb7-41a6-908a-f2db2b3527d7: created successfully Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "cinder-quobyte-b6c16f91-6e9e-49ac-9227-47bf180ba28e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-quobyte-b6c16f91-6e9e-49ac-9227-47bf180ba28e" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634518a-56ff-46f2-b17c-76435e6d1bdc]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:47 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e Jul 03 12:46:47 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:48 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394" returned: 0 in 0.956s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-8c14e27d-553e-4aca-9c41-0164f27d6394', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd71be7bc-d6d3-4359-b828-53d52d450568', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:46:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-8ad201dd-508d-4406-871d-6192e7e67db1 req-39256bb8-fd12-4df0-81aa-d72e6bdb53df tempest-ServerActionsTestOtherA-31762922 None] attachment_update completed successfully. Jul 03 12:46:48 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e" returned: 0 in 0.951s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:48 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e Jul 03 12:46:48 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-ea0a68c3-e85f-4c79-bef3-2e9131afa514-4176f341-1e06-46b5-8b10-229582a133c4" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ea0a68c3-e85f-4c79-bef3-2e9131afa514-4176f341-1e06-46b5-8b10-229582a133c4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Creating volume 4176f341-1e06-46b5-8b10-229582a133c4 from snapshot ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-4176f341-1e06-46b5-8b10-229582a133c4" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-4176f341-1e06-46b5-8b10-229582a133c4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] snapshot: ea0a68c3-e85f-4c79-bef3-2e9131afa514, volume: 4176f341-1e06-46b5-8b10-229582a133c4, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506240a-4d44-4499-86e6-18b95eb0cdd7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:49 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 Jul 03 12:46:49 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:49 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b6c16f91-6e9e-49ac-9227-47bf180ba28e" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-quobyte-b6c16f91-6e9e-49ac-9227-47bf180ba28e" released by "delete_volume" :: held 1.966s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Created reservations ['e1d106a5-2459-43f1-a0a4-f57e4ee1e78a', '5f2374f1-c764-42a7-a0b5-06d95fa712b3', 'baa5b64c-8208-4e60-bc4f-3bbf0b57102c', 'b6ef681d-46b5-478e-beac-09e47eda9b01'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:49 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:46:49 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:50 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514" returned: 0 in 1.050s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aec37e-5e48-442c-94d9-f2631b7a0151]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:50 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:46:50 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:50 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:46:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Deleted volume successfully. Jul 03 12:46:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b012fd1a-76b5-4cf3-b9c4-46640cce8a3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1370065984 None] Lock "cinder-b6c16f91-6e9e-49ac-9227-47bf180ba28e-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:46:51 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 0.937s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:51 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:51 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 Jul 03 12:46:51 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:58 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Jul 03 12:46:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4" returned: 0 in 7.442s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:46:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df39a0-0667-48e4-940e-4b2ad540df55]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:46:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:46:58 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:46:58 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:46:59 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:47:00 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 1.493s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:00 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:47:00 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Converted 1024.00 MB image at 137.58 MB/s Jul 03 12:47:00 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-60042526-7f4b-4aba-b266-947ed504eb3d req-314cd8f2-a676-445b-ae69-294f92dd2d13 tempest-ServerActionsTestOtherA-31762922 None] Terminate volume connection completed successfully. Jul 03 12:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-60042526-7f4b-4aba-b266-947ed504eb3d req-314cd8f2-a676-445b-ae69-294f92dd2d13 tempest-ServerActionsTestOtherA-31762922 None] Deleting attachment d71be7bc-d6d3-4359-b828-53d52d450568. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:47:00 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 Jul 03 12:47:00 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:01 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4" returned: 0 in 0.921s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-4176f341-1e06-46b5-8b10-229582a133c4" released by "_copy_volume_from_snapshot" :: held 11.986s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ea0a68c3-e85f-4c79-bef3-2e9131afa514-4176f341-1e06-46b5-8b10-229582a133c4" released by "_create_volume_from_snapshot" :: held 12.020s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.039s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-57323235-b694-4a40-bfe2-8450d70f7631 tempest-GroupSnapshotsTest-1594135489 None] Create group from source-snapshot-5934b108-7eb7-41a6-908a-f2db2b3527d7 completed successfully. Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:01 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:47:01 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-4176f341-1e06-46b5-8b10-229582a133c4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-4176f341-1e06-46b5-8b10-229582a133c4" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c2dde8-a5b7-4114-8f22-c06e3c619aa0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:02 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 Jul 03 12:47:02 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:02 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.042s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c049151f-c5be-4b5f-a277-298b3af40c4c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:03 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 Jul 03 12:47:03 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Flow 'volume_create_manager' (1aee5107-9626-4691-a5d0-72100b54e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb63045-1a71-47e4-9b7b-ab5b62a1b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb63045-1a71-47e4-9b7b-ab5b62a1b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-947206502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3dbd9d-9f12-45f6-a030-4533326e2829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be36be7cab864805979970ad5ed5fedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:03Z,use_quota=True,user_id='70b24622e4b3497e978abc2df05054d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b4885f-0f15-468c-bb45-be8be86ce340),volume_type_id=52b4885f-0f15-468c-bb45-be8be86ce340)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32133fb9-9d25-46e4-86cd-00d94be539ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32133fb9-9d25-46e4-86cd-00d94be539ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900ee8d8-21de-4e85-a29f-32e410eb8fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900ee8d8-21de-4e85-a29f-32e410eb8fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3dbd9d-9f12-45f6-a030-4533326e2829', 'volume_name': 'volume-7d3dbd9d-9f12-45f6-a030-4533326e2829', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4e219f-0615-49a6-8217-43b4250ca8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4e219f-0615-49a6-8217-43b4250ca8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a8a04-f015-49c9-8345-2b4ea1d32519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:03 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Volume 7d3dbd9d-9f12-45f6-a030-4533326e2829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3dbd9d-9f12-45f6-a030-4533326e2829', 'volume_size': 1} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:03 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4" returned: 0 in 1.106s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:03 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4 Jul 03 12:47:03 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:03 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-947206502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3dbd9d-9f12-45f6-a030-4533326e2829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be36be7cab864805979970ad5ed5fedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:03Z,use_quota=True,user_id='70b24622e4b3497e978abc2df05054d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b4885f-0f15-468c-bb45-be8be86ce340),volume_type_id=52b4885f-0f15-468c-bb45-be8be86ce340)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Creating volume 7d3dbd9d-9f12-45f6-a030-4533326e2829 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:47:03 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:04 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 1073741824 Jul 03 12:47:04 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-8c14e27d-553e-4aca-9c41-0164f27d6394', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56eff60b-ca90-4473-a206-601bcf7c0065', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:47:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-60042526-7f4b-4aba-b266-947ed504eb3d req-069dcabd-cafa-4ffe-9bf5-4b9c6d7fdf98 tempest-ServerActionsTestOtherA-31762922 None] attachment_update completed successfully. Jul 03 12:47:04 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4176f341-1e06-46b5-8b10-229582a133c4" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-4176f341-1e06-46b5-8b10-229582a133c4" released by "delete_volume" :: held 1.839s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['80ec470c-f77b-4aeb-aeea-1bda833d1d2e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:04 devstack cinder-volume[86966]: WARNING cinder.quota [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-685139044 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-685139044, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:04 devstack cinder-volume[86966]: WARNING cinder.quota [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-685139044 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-685139044, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['23dea5d6-d956-461a-81f3-235ed438c4b7', '57012543-5114-431e-8c2b-f6060a9b0b94', 'cf6cf8b4-fca2-4eb0-801b-86fe1f2c069d', '9e04e5ea-d045-4cc4-afe7-cd4ddf370e49'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:04 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:47:04 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 5934b108-7eb7-41a6-908a-f2db2b3527d7: deleting Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 5934b108-7eb7-41a6-908a-f2db2b3527d7: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-1a239ae6-2db8-47d1-aecd-0c3a102e058c" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-1a239ae6-2db8-47d1-aecd-0c3a102e058c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-ea0a68c3-e85f-4c79-bef3-2e9131afa514" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ea0a68c3-e85f-4c79-bef3-2e9131afa514" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Deleting offline snapshot ea0a68c3-e85f-4c79-bef3-2e9131afa514 of volume 1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] snapshot_file for this snap is: volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:47:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef716fce-c0dc-4de1-826e-4aec5ef42657]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:05 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 1073741824" returned: 0 in 1.268s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:05 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 Jul 03 12:47:05 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:05 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 Jul 03 12:47:05 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:05 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:47:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2a9c73cd-a70e-4d5c-8a22-f0ace7a38b42 tempest-GroupSnapshotsTest-1594135489 None] Delete group completed successfully. Jul 03 12:47:06 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514" returned: 0 in 1.131s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:47:06 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[39755f57-3ee6-4925-a6de-f22af98472d5]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a8a04-f015-49c9-8345-2b4ea1d32519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3dbd9d-9f12-45f6-a030-4533326e2829', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa4eec4-d136-43a6-a661-da213fe559d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Volume volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 (7d3dbd9d-9f12-45f6-a030-4533326e2829): created successfully Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa4eec4-d136-43a6-a661-da213fe559d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Flow 'volume_create_manager' (1aee5107-9626-4691-a5d0-72100b54e4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-746ce1cd-9f66-498f-9bed-50fb30c9d742 tempest-VolumeTypesAccessTest-1900415345 None] Created volume successfully. Jul 03 12:47:06 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:47:06 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Acquiring lock "cinder-7d3dbd9d-9f12-45f6-a030-4533326e2829-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Lock "cinder-7d3dbd9d-9f12-45f6-a030-4533326e2829-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Acquiring lock "cinder-quobyte-7d3dbd9d-9f12-45f6-a030-4533326e2829" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Lock "cinder-quobyte-7d3dbd9d-9f12-45f6-a030-4533326e2829" acquired by "delete_volume" :: waited 0.058s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bb6505-5775-4fda-ba1a-8450a3d5ed65]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:08 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 Jul 03 12:47:08 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:08 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 1.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:08 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 Jul 03 12:47:08 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:09 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829" returned: 0 in 1.118s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:09 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829 Jul 03 12:47:09 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:09 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514" returned: 0 in 1.471s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:09 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514 Jul 03 12:47:09 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:10 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d3dbd9d-9f12-45f6-a030-4533326e2829" returned: 0 in 1.027s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Lock "cinder-quobyte-7d3dbd9d-9f12-45f6-a030-4533326e2829" released by "delete_volume" :: held 2.245s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:10 devstack cinder-volume[86966]: WARNING cinder.quota [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-439880709 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-439880709, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:10 devstack cinder-volume[86966]: WARNING cinder.quota [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-439880709 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-439880709, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Created reservations ['753e08a8-09c3-448c-b1c8-f21044c44f20', '05fa64fa-c932-466d-8101-2ed0ef058a1f', '8804c49d-7efb-4426-8d97-2065eb7b5e36', '7cc2b088-12b8-44be-a1c0-d7b03bbd6030'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:10 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:47:10 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:10 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c.ea0a68c3-e85f-4c79-bef3-2e9131afa514" returned: 0 in 0.939s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ea0a68c3-e85f-4c79-bef3-2e9131afa514" released by "_delete_snapshot" :: held 5.599s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-1a239ae6-2db8-47d1-aecd-0c3a102e058c" released by "delete_snapshot" :: held 5.643s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:10 devstack cinder-volume[86966]: WARNING cinder.quota [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-685139044 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-685139044, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:10 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['eb709aae-3359-4f30-981a-cb4c5d0e860c', '0a414471-c338-4961-8586-a875ce6b57fd', 'b969c6f7-d10b-484c-9b9c-f481de4eb622', 'd4e316b9-4397-4a89-97be-b997c3a99800'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-89c04b23-ecb5-4ac8-ada5-29e8ed0620a2 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 5934b108-7eb7-41a6-908a-f2db2b3527d7: deleted successfully Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.139s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:47:11 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Deleted volume successfully. Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd371636-4c54-48e0-8502-9363dca74ed2 tempest-VolumeTypesAccessTest-1900415345 None] Lock "cinder-7d3dbd9d-9f12-45f6-a030-4533326e2829-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-1a239ae6-2db8-47d1-aecd-0c3a102e058c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-1a239ae6-2db8-47d1-aecd-0c3a102e058c" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaacdd09-be95-42c4-add7-dcc4a441aea9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:12 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:47:12 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:13 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 1.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:13 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c Jul 03 12:47:13 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:15 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1a239ae6-2db8-47d1-aecd-0c3a102e058c" returned: 0 in 1.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-1a239ae6-2db8-47d1-aecd-0c3a102e058c" released by "delete_volume" :: held 3.676s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['22bc4530-d604-42f8-8b17-8b01c2fcea97'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:15 devstack cinder-volume[86966]: WARNING cinder.db.sqlalchemy.api [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-685139044'] Jul 03 12:47:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['1d48acb4-56e7-4662-979a-f403e25ff903', 'c8cbae01-2e2e-4bfc-b573-e917f0be3242', '3d8c4064-109a-436e-b4c4-a85deca3c00e', '71e87c57-11a0-4ca8-8af9-67bd9daf3eac'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:16 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:47:16 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:17 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e1d0f72b-534f-4d60-9295-fa4410637e84 tempest-GroupSnapshotsTest-1594135489 None] Group tempest-GroupSnapshotsTest-Group-430633558: creating Jul 03 12:47:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.528s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:17 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:47:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ecf4dde9-9faa-4db9-ac28-93ab35dd83f7 tempest-GroupSnapshotsTest-1594135489 None] Delete group completed successfully. Jul 03 12:47:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e1d0f72b-534f-4d60-9295-fa4410637e84 tempest-GroupSnapshotsTest-1594135489 None] Group tempest-GroupSnapshotsTest-Group-430633558: created successfully Jul 03 12:47:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e1d0f72b-534f-4d60-9295-fa4410637e84 tempest-GroupSnapshotsTest-1594135489 None] Create group completed successfully. Jul 03 12:47:19 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:47:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (07ee4802-cd39-48f2-a6b2-55a35ccf43ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b1e906-d7e1-4d91-8d51-455291b91578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b1e906-d7e1-4d91-8d51-455291b91578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-174199886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70307301-4b3c-41e1-a8d6-eed95cc9a25d,host='devstack@QuobyteHD#QuobyteHD',id=95540f5b-2623-4caa-a2db-61e0abf92e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:20Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6),volume_type_id=9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f89fa00-a221-4ef5-8282-807104e96735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f89fa00-a221-4ef5-8282-807104e96735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395ac21f-c1dc-47e2-8181-0a1f6238f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395ac21f-c1dc-47e2-8181-0a1f6238f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95540f5b-2623-4caa-a2db-61e0abf92e60', 'volume_name': 'volume-95540f5b-2623-4caa-a2db-61e0abf92e60', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345a45d7-c718-4c3e-adf1-9cd4e63dd5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345a45d7-c718-4c3e-adf1-9cd4e63dd5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ad3600-3d09-4777-a1bc-ccf626588dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Volume 95540f5b-2623-4caa-a2db-61e0abf92e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95540f5b-2623-4caa-a2db-61e0abf92e60', 'volume_size': 1} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70307301-4b3c-41e1-a8d6-eed95cc9a25d,created_at=2026-07-03T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-174199886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70307301-4b3c-41e1-a8d6-eed95cc9a25d,host='devstack@QuobyteHD#QuobyteHD',id=95540f5b-2623-4caa-a2db-61e0abf92e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:20Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6),volume_type_id=9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Creating volume 95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:47:20 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:20 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 1073741824 Jul 03 12:47:20 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:21 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 1073741824" returned: 0 in 1.173s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:21 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 Jul 03 12:47:21 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:22 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ad3600-3d09-4777-a1bc-ccf626588dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95540f5b-2623-4caa-a2db-61e0abf92e60', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a97c320-6105-4c90-9b66-a6c073f6581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:22 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Volume volume-95540f5b-2623-4caa-a2db-61e0abf92e60 (95540f5b-2623-4caa-a2db-61e0abf92e60): created successfully Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a97c320-6105-4c90-9b66-a6c073f6581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (07ee4802-cd39-48f2-a6b2-55a35ccf43ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e3847497-0c70-4bbb-829f-b537f39c3fe6 tempest-GroupSnapshotsTest-1594135489 None] Created volume successfully. Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (8ba1815a-00ef-4707-bebb-c335b2c5ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67343fa-749a-4bfd-a7b4-d52b3aebf187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67343fa-749a-4bfd-a7b4-d52b3aebf187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-463252592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70307301-4b3c-41e1-a8d6-eed95cc9a25d,host='devstack@QuobyteHD#QuobyteHD',id=ed98702a-049b-488e-9453-cd30e42c25bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:24Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6),volume_type_id=9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c48367-487c-49f3-a4fa-fd6afd8c38e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c48367-487c-49f3-a4fa-fd6afd8c38e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b6da1e-a3d9-436e-90aa-cb9ef2e2fb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b6da1e-a3d9-436e-90aa-cb9ef2e2fb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed98702a-049b-488e-9453-cd30e42c25bd', 'volume_name': 'volume-ed98702a-049b-488e-9453-cd30e42c25bd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5db58b1-7d1b-4c22-82be-fcf5428ae193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5db58b1-7d1b-4c22-82be-fcf5428ae193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88703ba3-de41-4008-b50c-6e5ade6bd3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:23 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Volume ed98702a-049b-488e-9453-cd30e42c25bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed98702a-049b-488e-9453-cd30e42c25bd', 'volume_size': 1} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70307301-4b3c-41e1-a8d6-eed95cc9a25d,created_at=2026-07-03T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-463252592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70307301-4b3c-41e1-a8d6-eed95cc9a25d,host='devstack@QuobyteHD#QuobyteHD',id=ed98702a-049b-488e-9453-cd30e42c25bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:24Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6),volume_type_id=9fce1207-e4bd-4ab4-b3a5-a513a1c6fba6)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Creating volume ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:47:23 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:23 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd 1073741824 Jul 03 12:47:23 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:24 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd 1073741824" returned: 0 in 1.056s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:24 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd Jul 03 12:47:24 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:25 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88703ba3-de41-4008-b50c-6e5ade6bd3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed98702a-049b-488e-9453-cd30e42c25bd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9457af5f-23ba-4448-ab81-9b2f263bf062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Volume volume-ed98702a-049b-488e-9453-cd30e42c25bd (ed98702a-049b-488e-9453-cd30e42c25bd): created successfully Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9457af5f-23ba-4448-ab81-9b2f263bf062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (8ba1815a-00ef-4707-bebb-c335b2c5ab89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b4b80885-6004-47d6-bc61-c5712f16dbed tempest-GroupSnapshotsTest-1594135489 None] Created volume successfully. Jul 03 12:47:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4adcd999-e0cd-434e-8880-9a7a4639f0a5 tempest-GroupSnapshotsTest-1594135489 None] Update group completed successfully. Jul 03 12:47:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9bccd327-2796-4766-9f5b-fd154b3ac042 tempest-GroupSnapshotsTest-1594135489 None] Update group completed successfully. Jul 03 12:47:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dcfa0be0-4e5d-4c8f-95bd-e015a17fa8dc tempest-GroupSnapshotsTest-1594135489 None] Update group completed successfully. Jul 03 12:47:29 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=87,cinder:UPDATE=73,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:47:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e892167f-14d7-43d3-a7a1-497fd460be1b tempest-GroupSnapshotsTest-1594135489 None] Update group completed successfully. Jul 03 12:47:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] GroupSnapshot 967565bb-8b0b-44fb-819a-002cae54cd8e: creating. Jul 03 12:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Group snapshot 967565bb-8b0b-44fb-819a-002cae54cd8e: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 12:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Creating offline snapshot 025d1a2d-250f-46c1-b776-4fb671958189 of volume 95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:47:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b469fa-b485-46bb-a749-fae2632700cf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:31 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 Jul 03 12:47:31 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:32 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:32 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 1G Jul 03 12:47:32 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:33 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 1G" returned: 0 in 0.983s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95540f5b-2623-4caa-a2db-61e0abf92e60 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:33 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95540f5b-2623-4caa-a2db-61e0abf92e60 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 Jul 03 12:47:33 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:34 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95540f5b-2623-4caa-a2db-61e0abf92e60 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189" returned: 0 in 0.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:34 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:47:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:34 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 Jul 03 12:47:34 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:34 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:35 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info Jul 03 12:47:35 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:35 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:35 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:47:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:35 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info Jul 03 12:47:35 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:36 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.info" returned: 0 in 0.879s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.261s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Creating offline snapshot 31adf4a4-5d0f-40dc-a42f-6747a5f8f012 of volume ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe75de-70bc-42ff-acde-93d083e6928f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:36 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd Jul 03 12:47:36 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Flow 'volume_create_manager' (1c1be86c-9554-47a1-8e44-214e0a055eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f2e42f-5237-4ea6-bf7f-ca4efffe91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f2e42f-5237-4ea6-bf7f-ca4efffe91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-220137715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36d77ee-23f9-4fba-b08d-35e43707b67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43811ae5b5c4bcd8be311fc92b10f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:38Z,use_quota=True,user_id='70a46878012745b9af28f96926154bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aa24a2-71eb-4c97-ad27-534a5b970502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aa24a2-71eb-4c97-ad27-534a5b970502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9af8eb-c4e9-4f29-bdc3-c13513079acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:37 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9af8eb-c4e9-4f29-bdc3-c13513079acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36d77ee-23f9-4fba-b08d-35e43707b67a', 'volume_name': 'volume-f36d77ee-23f9-4fba-b08d-35e43707b67a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e992f901-027a-4e40-a6b8-e117776cb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e992f901-027a-4e40-a6b8-e117776cb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c4529d-a6ea-43e5-be06-d8e0beb04c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Volume f36d77ee-23f9-4fba-b08d-35e43707b67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36d77ee-23f9-4fba-b08d-35e43707b67a', 'volume_size': 1} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd" returned: 0 in 1.093s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:37 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 1G Jul 03 12:47:37 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:38 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 1G" returned: 0 in 1.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed98702a-049b-488e-9453-cd30e42c25bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:38 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed98702a-049b-488e-9453-cd30e42c25bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 Jul 03 12:47:38 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Flow 'volume_create_manager' (7316d38d-20fb-4262-90fd-b46058b94b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac04debe-f4e6-4045-a877-c3181faff995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac04debe-f4e6-4045-a877-c3181faff995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2007991908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbcd5d2-aaa7-447e-a399-318e58201d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe58c3c1dad04c6c98363169577e271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:40Z,use_quota=True,user_id='cb52df60acc64f378d4f4bdf16c643f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfa98d3-8637-4fb7-b670-09143aa12557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfa98d3-8637-4fb7-b670-09143aa12557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b473bda-07e7-4174-9255-922ebf2d3d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b473bda-07e7-4174-9255-922ebf2d3d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbcd5d2-aaa7-447e-a399-318e58201d6f', 'volume_name': 'volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e1457d-d382-4325-8dec-a72b14a96497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e1457d-d382-4325-8dec-a72b14a96497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54881193-973f-4dbc-8473-62601c69376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Volume 9bbcd5d2-aaa7-447e-a399-318e58201d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f', 'volume_size': 1} Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:39 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed98702a-049b-488e-9453-cd30e42c25bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012" returned: 0 in 0.817s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:39 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:47:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:39 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 Jul 03 12:47:39 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4db8c185-a692-4bef-9005-d52fe1adfe90 req-4046a9d1-2005-4421-af59-db73ec5b6e23 tempest-ServerActionsTestOtherA-31762922 None] Terminate volume connection completed successfully. Jul 03 12:47:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4db8c185-a692-4bef-9005-d52fe1adfe90 req-4046a9d1-2005-4421-af59-db73ec5b6e23 tempest-ServerActionsTestOtherA-31762922 None] Deleting attachment 56eff60b-ca90-4473-a206-601bcf7c0065. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:47:40 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012" returned: 0 in 0.665s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:40 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info Jul 03 12:47:40 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:41 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:41 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:41 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info Jul 03 12:47:41 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:41 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.info" returned: 0 in 0.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.986s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.854s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-220137715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36d77ee-23f9-4fba-b08d-35e43707b67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43811ae5b5c4bcd8be311fc92b10f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:38Z,use_quota=True,user_id='70a46878012745b9af28f96926154bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Creating volume f36d77ee-23f9-4fba-b08d-35e43707b67a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:47:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:47:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:41 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a 1073741824 Jul 03 12:47:41 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-55bfe82a-c3e0-4e32-ab64-e879e8cb69d0 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 967565bb-8b0b-44fb-819a-002cae54cd8e: created successfully Jul 03 12:47:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 967565bb-8b0b-44fb-819a-002cae54cd8e: deleting Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 967565bb-8b0b-44fb-819a-002cae54cd8e: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-95540f5b-2623-4caa-a2db-61e0abf92e60" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-95540f5b-2623-4caa-a2db-61e0abf92e60" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-025d1a2d-250f-46c1-b776-4fb671958189" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-025d1a2d-250f-46c1-b776-4fb671958189" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Deleting offline snapshot 025d1a2d-250f-46c1-b776-4fb671958189 of volume 95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] snapshot_file for this snap is: volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2acb46e-5178-4c72-9ca7-c40b788f3832]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:42 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 Jul 03 12:47:42 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:42 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a 1073741824" returned: 0 in 1.010s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:42 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a Jul 03 12:47:42 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:43 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189" returned: 0 in 0.904s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95540f5b-2623-4caa-a2db-61e0abf92e60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc6838f-1ace-43c3-97ba-1bf59f8ce10e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:43 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 Jul 03 12:47:43 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:43 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2007991908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbcd5d2-aaa7-447e-a399-318e58201d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe58c3c1dad04c6c98363169577e271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:40Z,use_quota=True,user_id='cb52df60acc64f378d4f4bdf16c643f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Creating volume 9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:47:43 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c4529d-a6ea-43e5-be06-d8e0beb04c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36d77ee-23f9-4fba-b08d-35e43707b67a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a4f9aa-a985-4244-8b7e-ae4d6c9a3eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:43 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f 1073741824 Jul 03 12:47:43 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Volume volume-f36d77ee-23f9-4fba-b08d-35e43707b67a (f36d77ee-23f9-4fba-b08d-35e43707b67a): created successfully Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a4f9aa-a985-4244-8b7e-ae4d6c9a3eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Flow 'volume_create_manager' (1c1be86c-9554-47a1-8e44-214e0a055eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-de43ecb0-ebfd-41c4-b5a4-e1e0154af140 tempest-AttachVolumeNegativeTest-29985512 None] Created volume successfully. Jul 03 12:47:44 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:44 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 Jul 03 12:47:44 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:44 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f 1073741824" returned: 0 in 1.286s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:44 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f Jul 03 12:47:44 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:45 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189" returned: 0 in 0.957s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:45 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189 Jul 03 12:47:45 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:45 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f" returned: 0 in 0.829s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54881193-973f-4dbc-8473-62601c69376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0350296a-7e66-40d3-9038-745a43eab7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Volume volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f (9bbcd5d2-aaa7-447e-a399-318e58201d6f): created successfully Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0350296a-7e66-40d3-9038-745a43eab7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Flow 'volume_create_manager' (7316d38d-20fb-4262-90fd-b46058b94b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8100be78-6831-47df-acd2-1162ac8d4199 tempest-SnapshotMetadataTestJSON-1333585637 None] Created volume successfully. Jul 03 12:47:46 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60.025d1a2d-250f-46c1-b776-4fb671958189" returned: 0 in 0.846s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-025d1a2d-250f-46c1-b776-4fb671958189" released by "_delete_snapshot" :: held 3.925s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-95540f5b-2623-4caa-a2db-61e0abf92e60" released by "delete_snapshot" :: held 3.958s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-ed98702a-049b-488e-9453-cd30e42c25bd" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ed98702a-049b-488e-9453-cd30e42c25bd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-31adf4a4-5d0f-40dc-a42f-6747a5f8f012" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-31adf4a4-5d0f-40dc-a42f-6747a5f8f012" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Deleting offline snapshot 31adf4a4-5d0f-40dc-a42f-6747a5f8f012 of volume ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] snapshot_file for this snap is: volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8844e4f6-7cec-4559-9e38-aa1daf32d02a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Creating offline snapshot e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf of volume 9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed8917-c2b0-473a-897a-601cffa67b96]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:46 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 Jul 03 12:47:46 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:46 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f Jul 03 12:47:46 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:47 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012" returned: 0 in 1.084s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed98702a-049b-488e-9453-cd30e42c25bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[22743dce-96a6-46af-844c-bffd6debdcd2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:47 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f" returned: 0 in 1.014s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:47 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf 1G Jul 03 12:47:47 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:47 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd Jul 03 12:47:47 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:48 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:48 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 Jul 03 12:47:48 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:48 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf 1G" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:48 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf Jul 03 12:47:48 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:49 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:49 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012 Jul 03 12:47:49 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:49 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:49 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf is being set with open permissions: ugo+rw Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:49 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf Jul 03 12:47:49 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:49 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd.31adf4a4-5d0f-40dc-a42f-6747a5f8f012" returned: 0 in 0.717s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-31adf4a4-5d0f-40dc-a42f-6747a5f8f012" released by "_delete_snapshot" :: held 3.681s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:49 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" returned: 0 in 0.699s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ed98702a-049b-488e-9453-cd30e42c25bd" released by "delete_snapshot" :: held 3.722s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:50 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info Jul 03 12:47:50 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:50 devstack cinder-volume[86966]: WARNING cinder.quota [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-339127431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-339127431, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:50 devstack cinder-volume[86966]: WARNING cinder.quota [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-339127431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-339127431, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:50 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['3b4b4d04-09df-48e2-a737-2c8a6de08176', '8b939fe8-c5e6-414f-95d9-538ab328fc83', 'a916c3f1-6060-4181-bc1f-38629b274af5', '166004a6-10d3-48dd-b00e-04a08eb67bcc'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:50 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['cc8e42d9-3082-48f8-a9d5-163bd3fafc40', '3288a7a2-00c5-4f3b-88b2-e038ec80cc75', 'c57f5095-3660-412f-809a-309cdbf358d0', '7494297a-5146-4797-8ee5-13d8208127bb'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ae16f00-b252-450f-939f-238b55ea482c tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 967565bb-8b0b-44fb-819a-002cae54cd8e: deleted successfully Jul 03 12:47:50 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info" returned: 0 in 0.720s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:50 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info is being set with open permissions: ugo+rw Jul 03 12:47:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:50 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info Jul 03 12:47:50 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "cinder-8c14e27d-553e-4aca-9c41-0164f27d6394-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Lock "cinder-8c14e27d-553e-4aca-9c41-0164f27d6394-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:51 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.info" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.142s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.158s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1179f9-9f0e-4eba-b10d-6e9aa256fc69]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cfd98a55-f050-418b-a8d0-6ba642ee279a tempest-SnapshotMetadataTestJSON-1333585637 None] Create snapshot completed successfully Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "cinder-quobyte-8c14e27d-553e-4aca-9c41-0164f27d6394" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Lock "cinder-quobyte-8c14e27d-553e-4aca-9c41-0164f27d6394" acquired by "delete_volume" :: waited 0.050s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-95540f5b-2623-4caa-a2db-61e0abf92e60" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07aa99e-4c73-42a2-99e6-5020420384e7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:51 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a Jul 03 12:47:51 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-95540f5b-2623-4caa-a2db-61e0abf92e60" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300c4fb-1605-447f-80ea-f5bd52267d3f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:51 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 Jul 03 12:47:51 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:51 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 Jul 03 12:47:51 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:52 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-f36d77ee-23f9-4fba-b08d-35e43707b67a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f491694-c636-4d60-bc76-ea0fa49a5a54', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:47:52 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394" returned: 0 in 0.890s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:52 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394 Jul 03 12:47:52 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-40ab8437-5850-4966-a6b1-eaa52f13bb4f req-b1e92f21-91ab-4822-84ee-87c5625403cd tempest-AttachVolumeNegativeTest-29985512 None] attachment_update completed successfully. Jul 03 12:47:52 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60" returned: 0 in 0.937s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:52 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60 Jul 03 12:47:52 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:53 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8c14e27d-553e-4aca-9c41-0164f27d6394" returned: 0 in 0.853s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Lock "cinder-quobyte-8c14e27d-553e-4aca-9c41-0164f27d6394" released by "delete_volume" :: held 1.820s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Created reservations ['b75d16e6-fbbf-4120-aedd-cd60df00c7d0', 'e9553a86-f8fc-48ac-b7f1-f05c1cf38c6c', '54f79a33-9b48-470e-8195-e374f60ef18d', '39dfcdf4-ce75-4d50-ac0d-81d40f4958dc'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:53 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-95540f5b-2623-4caa-a2db-61e0abf92e60" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-95540f5b-2623-4caa-a2db-61e0abf92e60" released by "delete_volume" :: held 1.947s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-ed98702a-049b-488e-9453-cd30e42c25bd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:53 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:47:53 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ed98702a-049b-488e-9453-cd30e42c25bd" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed9a2f-8adf-4b01-96e0-3d871456800d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "cinder-e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "cinder-quobyte-9bbcd5d2-aaa7-447e-a399-318e58201d6f" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-quobyte-9bbcd5d2-aaa7-447e-a399-318e58201d6f" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "cinder-quobyte-e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:54 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd Jul 03 12:47:54 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-quobyte-e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Deleting offline snapshot e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf of volume 9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] snapshot_file for this snap is: volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb099b-d3a6-4320-b02e-19dc2b60f8a6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:54 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf Jul 03 12:47:54 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:54 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.963s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:47:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Deleted volume successfully. Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-45604be7-f39e-43cb-8528-168d142b7336 tempest-ServerActionsTestOtherA-31762922 None] Lock "cinder-8c14e27d-553e-4aca-9c41-0164f27d6394-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:54 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd" returned: 0 in 1.115s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:55 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd Jul 03 12:47:55 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:55 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" returned: 0 in 1.160s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:47:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0e4360-2a29-4dcc-86d1-f216e0b00059]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:55 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f Jul 03 12:47:55 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:56 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ed98702a-049b-488e-9453-cd30e42c25bd" returned: 0 in 1.167s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-ed98702a-049b-488e-9453-cd30e42c25bd" released by "delete_volume" :: held 2.397s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['cdbb411c-f06f-445d-98c5-3e55d1a1c963'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:56 devstack cinder-volume[86966]: WARNING cinder.quota [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-339127431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-339127431, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['9078c94a-5403-4e09-af1b-64ba2b9253e0', '7e3035bb-a06f-41a1-ab81-645058e78ff3', 'c7a7910e-748d-459a-8cf4-4eb118a795b6', 'a5a82230-cd2f-4eb7-8c82-83e89a2a7efc'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['295cdc41-9990-4685-bed6-ae8ed5630fe9', '705788e7-8ecd-466d-b013-035593737460', '25c83152-1094-4c45-b849-4f262cec430c', '1fbbb991-0099-4a35-99e1-746452d5b247'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:56 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:47:56 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:56 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f" returned: 0 in 1.159s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:56 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf Jul 03 12:47:56 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8fe3fc49-43ac-467c-98ae-6b1abfa20a5d tempest-GroupSnapshotsTest-1594135489 None] Group tempest-GroupSnapshotsTest-Group-2083463523: creating Jul 03 12:47:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8fe3fc49-43ac-467c-98ae-6b1abfa20a5d tempest-GroupSnapshotsTest-1594135489 None] Group tempest-GroupSnapshotsTest-Group-2083463523: created successfully Jul 03 12:47:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8fe3fc49-43ac-467c-98ae-6b1abfa20a5d tempest-GroupSnapshotsTest-1594135489 None] Create group completed successfully. Jul 03 12:47:57 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.023s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:47:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-97d6be68-dd84-4e43-8afe-7c73bd8f77cb tempest-GroupSnapshotsTest-1594135489 None] Delete group completed successfully. Jul 03 12:47:57 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" returned: 0 in 1.011s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:57 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf Jul 03 12:47:57 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:58 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 03 12:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f.e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-quobyte-e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf" released by "_delete_snapshot" :: held 4.327s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-quobyte-9bbcd5d2-aaa7-447e-a399-318e58201d6f" released by "delete_snapshot" :: held 4.369s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:58 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Created reservations ['c018ebf1-6392-46f1-a6c5-97cbda66c997', 'ae7c4aa5-87fa-440a-be0e-f6ad24417389', 'e329cf1b-6210-4f5f-a6c1-62bb23062e5e', 'cf31ed29-b8ba-4b07-85f1-691ade6b9141'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:47:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Delete snapshot completed successfully. Jul 03 12:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-07055499-ded0-4bc0-b7b5-c3983a3f2d9a tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-e37c8511-c0e7-4ada-ae72-77bc4ec7b6cf-delete_snapshot" released by "delete_snapshot" :: held 4.628s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (953a4422-c936-4d68-8968-13f074caed29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d9e9a4-3b8a-4118-88c2-6b57776dc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d9e9a4-3b8a-4118-88c2-6b57776dc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897620774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=955bb9f9-5aec-4224-ab33-223a74c3529e,host='devstack@QuobyteHD#QuobyteHD',id=9df42b52-5e8e-419d-a296-120e1186fb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:59Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec20ff6e-969f-44ff-8cf2-1732383c50ad),volume_type_id=ec20ff6e-969f-44ff-8cf2-1732383c50ad)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e690c19-eae6-4190-80e6-5a95f1679034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e690c19-eae6-4190-80e6-5a95f1679034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad7cfdc-ccee-4658-8514-d7520b6cb828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad7cfdc-ccee-4658-8514-d7520b6cb828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df42b52-5e8e-419d-a296-120e1186fb45', 'volume_name': 'volume-9df42b52-5e8e-419d-a296-120e1186fb45', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ee9346-68de-4415-8b07-94bf156cf49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ee9346-68de-4415-8b07-94bf156cf49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd02f10f-c896-41dd-894f-b291d43b64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:47:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Volume 9df42b52-5e8e-419d-a296-120e1186fb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df42b52-5e8e-419d-a296-120e1186fb45', 'volume_size': 1} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=955bb9f9-5aec-4224-ab33-223a74c3529e,created_at=2026-07-03T10:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897620774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=955bb9f9-5aec-4224-ab33-223a74c3529e,host='devstack@QuobyteHD#QuobyteHD',id=9df42b52-5e8e-419d-a296-120e1186fb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9db59297374381a83b0601dcfe2a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:47:59Z,use_quota=True,user_id='35af8875cdea47ffaa9a4a877e45a4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec20ff6e-969f-44ff-8cf2-1732383c50ad),volume_type_id=ec20ff6e-969f-44ff-8cf2-1732383c50ad)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Creating volume 9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:47:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:59 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 1073741824 Jul 03 12:47:59 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "cinder-9bbcd5d2-aaa7-447e-a399-318e58201d6f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-9bbcd5d2-aaa7-447e-a399-318e58201d6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "cinder-quobyte-9bbcd5d2-aaa7-447e-a399-318e58201d6f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-quobyte-9bbcd5d2-aaa7-447e-a399-318e58201d6f" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61fe3ba-518c-4464-a4ca-eed78ead8b40]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:47:59 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f Jul 03 12:47:59 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:00 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=117,cinder:UPDATE=111,cinder:INSERT=24,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:48:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-5a035cad-11d2-4224-bf2c-f9b599711694 req-0ef00744-e4b1-44e6-b5af-f63a0452bd4c tempest-AttachVolumeNegativeTest-29985512 None] Terminate volume connection completed successfully. Jul 03 12:48:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5a035cad-11d2-4224-bf2c-f9b599711694 req-0ef00744-e4b1-44e6-b5af-f63a0452bd4c tempest-AttachVolumeNegativeTest-29985512 None] Deleting attachment 9f491694-c636-4d60-bc76-ea0fa49a5a54. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:48:00 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 1073741824" returned: 0 in 1.160s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:00 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 Jul 03 12:48:00 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:00 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f" returned: 0 in 1.101s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:00 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f Jul 03 12:48:00 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:01 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd02f10f-c896-41dd-894f-b291d43b64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df42b52-5e8e-419d-a296-120e1186fb45', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54963b2c-55b5-4c4a-9294-e7a263c8a092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Volume volume-9df42b52-5e8e-419d-a296-120e1186fb45 (9df42b52-5e8e-419d-a296-120e1186fb45): created successfully Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54963b2c-55b5-4c4a-9294-e7a263c8a092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Flow 'volume_create_manager' (953a4422-c936-4d68-8968-13f074caed29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fab1bf1b-c799-4a6d-bed1-4c35fff60a2d tempest-GroupSnapshotsTest-1594135489 None] Created volume successfully. Jul 03 12:48:01 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbcd5d2-aaa7-447e-a399-318e58201d6f" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-quobyte-9bbcd5d2-aaa7-447e-a399-318e58201d6f" released by "delete_volume" :: held 1.967s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Created reservations ['1093a9a0-8914-40cc-aa33-73c81b475201', 'f20602e2-ded0-43b6-bf81-341a168ce568', '07dd9d95-76e5-4e0d-975e-1777d867eabd', '24dfb940-a0ef-4ac9-8d37-0961372dbdff'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:01 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:48:01 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:01 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:48:01 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:02 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.076s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:48:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Deleted volume successfully. Jul 03 12:48:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7aac133d-d8ba-47db-9b2a-21173506b52f tempest-SnapshotMetadataTestJSON-1333585637 None] Lock "cinder-9bbcd5d2-aaa7-447e-a399-318e58201d6f-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:02 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.009s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:48:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] GroupSnapshot 1ac0899f-5cb7-4344-a951-e0095177a6de: creating. Jul 03 12:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Group snapshot 1ac0899f-5cb7-4344-a951-e0095177a6de: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 12:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Creating offline snapshot 17636e75-5e8c-4173-9d7b-dc4e8a3f1123 of volume 9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:48:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[20613b50-cef7-4c1b-a3b7-4bc67bc2ba1b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:03 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 Jul 03 12:48:03 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:04 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45" returned: 0 in 1.333s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:04 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 1G Jul 03 12:48:04 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:05 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 1G" returned: 0 in 1.139s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df42b52-5e8e-419d-a296-120e1186fb45 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:05 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df42b52-5e8e-419d-a296-120e1186fb45 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 Jul 03 12:48:05 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:06 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df42b52-5e8e-419d-a296-120e1186fb45 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123" returned: 0 in 1.039s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:06 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:48:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:06 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 Jul 03 12:48:06 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:07 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123" returned: 0 in 0.866s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:07 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info Jul 03 12:48:07 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:08 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info" returned: 0 in 0.928s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:08 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info Jul 03 12:48:08 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:09 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.info" returned: 0 in 0.958s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.406s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-64cae8c3-aa7a-45eb-9049-c0d42ca11b10 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 1ac0899f-5cb7-4344-a951-e0095177a6de: created successfully Jul 03 12:48:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 1ac0899f-5cb7-4344-a951-e0095177a6de: deleting Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 1ac0899f-5cb7-4344-a951-e0095177a6de: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-9df42b52-5e8e-419d-a296-120e1186fb45" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-9df42b52-5e8e-419d-a296-120e1186fb45" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-17636e75-5e8c-4173-9d7b-dc4e8a3f1123" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-17636e75-5e8c-4173-9d7b-dc4e8a3f1123" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Deleting offline snapshot 17636e75-5e8c-4173-9d7b-dc4e8a3f1123 of volume 9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] snapshot_file for this snap is: volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40949d-185a-4846-afbe-9c47cf61ab40]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (da2936f7-39cc-4e12-9342-0bae66442e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b2e6a9-308f-424d-80bc-b002d3475458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b2e6a9-308f-424d-80bc-b002d3475458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2063651322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82711680-9fd6-47f9-9761-78b688fda06e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:11Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea79732-c682-4391-8d7e-01c95c459318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea79732-c682-4391-8d7e-01c95c459318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d275012b-0690-46f5-86ed-684e673cc362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d275012b-0690-46f5-86ed-684e673cc362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82711680-9fd6-47f9-9761-78b688fda06e', 'volume_name': 'volume-82711680-9fd6-47f9-9761-78b688fda06e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6700280a-7b05-46ce-8ecf-e5fc68d51802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6700280a-7b05-46ce-8ecf-e5fc68d51802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d94008e-3e96-4bf0-9164-0d10eacf6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Volume 82711680-9fd6-47f9-9761-78b688fda06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82711680-9fd6-47f9-9761-78b688fda06e', 'volume_size': 1} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2063651322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82711680-9fd6-47f9-9761-78b688fda06e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:11Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Creating volume 82711680-9fd6-47f9-9761-78b688fda06e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:48:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:11 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e 1073741824 Jul 03 12:48:11 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:11 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 Jul 03 12:48:11 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:12 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123" returned: 0 in 1.124s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df42b52-5e8e-419d-a296-120e1186fb45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:48:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bddaf11-84f7-487a-8dae-4fa0a1d5cb79]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:12 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 Jul 03 12:48:12 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:12 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e 1073741824" returned: 0 in 1.314s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:12 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e Jul 03 12:48:12 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:13 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e" returned: 0 in 1.000s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d94008e-3e96-4bf0-9164-0d10eacf6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82711680-9fd6-47f9-9761-78b688fda06e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1212f2c9-73ca-4d91-a746-f30d96c0201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:13 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45" returned: 0 in 1.417s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Volume volume-82711680-9fd6-47f9-9761-78b688fda06e (82711680-9fd6-47f9-9761-78b688fda06e): created successfully Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1212f2c9-73ca-4d91-a746-f30d96c0201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (da2936f7-39cc-4e12-9342-0bae66442e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:13 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 Jul 03 12:48:13 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-56712434-e022-4082-ab70-30bac577073b tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:48:14 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123" returned: 0 in 1.110s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:15 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123 Jul 03 12:48:15 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (67bf6ea6-2ee8-4d43-a4df-e43f607bd95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98359f6-c59f-465a-9d55-ad8d83167c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98359f6-c59f-465a-9d55-ad8d83167c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-991202364',display_name='tempest-VolumesGetTest-Volume-235840910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96204200-c982-4b7a-9be0-43a71b643e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:15Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f573622d-b61a-4777-9af7-89a96b5f944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f573622d-b61a-4777-9af7-89a96b5f944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fcce10-3f5c-4e48-ad4c-497f1b4b9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fcce10-3f5c-4e48-ad4c-497f1b4b9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96204200-c982-4b7a-9be0-43a71b643e16', 'volume_name': 'volume-96204200-c982-4b7a-9be0-43a71b643e16', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b3b9eb-258a-40dc-8527-5c67f24566a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b3b9eb-258a-40dc-8527-5c67f24566a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f759692f-3c9d-4d35-872a-05a7b7b70603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Volume 96204200-c982-4b7a-9be0-43a71b643e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96204200-c982-4b7a-9be0-43a71b643e16', 'volume_size': 1} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-991202364',display_name='tempest-VolumesGetTest-Volume-235840910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96204200-c982-4b7a-9be0-43a71b643e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:15Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Creating volume 96204200-c982-4b7a-9be0-43a71b643e16 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:48:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:15 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 1073741824 Jul 03 12:48:15 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:15 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45.17636e75-5e8c-4173-9d7b-dc4e8a3f1123" returned: 0 in 0.928s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-17636e75-5e8c-4173-9d7b-dc4e8a3f1123" released by "_delete_snapshot" :: held 4.758s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-9df42b52-5e8e-419d-a296-120e1186fb45" released by "delete_snapshot" :: held 4.797s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:16 devstack cinder-volume[86966]: WARNING cinder.quota [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1436744958 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1436744958, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:48:16 devstack cinder-volume[86966]: WARNING cinder.quota [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1436744958 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1436744958, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:48:16 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['227caa05-9bce-4702-8fb3-7ae9b39c0ed3', '93c44847-2536-4d07-a9e5-6baac8ad5860', 'effa9e63-498b-4637-a050-86f84774c340', 'fd0e0532-44ef-4476-83d0-440992919552'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:48:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a44aecbe-dc5e-4cbc-93b2-94c6e1018073 tempest-GroupSnapshotsTest-1594135489 None] group_snapshot 1ac0899f-5cb7-4344-a951-e0095177a6de: deleted successfully Jul 03 12:48:16 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 1073741824" returned: 0 in 1.357s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:16 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 Jul 03 12:48:16 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "cinder-quobyte-9df42b52-5e8e-419d-a296-120e1186fb45" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-9df42b52-5e8e-419d-a296-120e1186fb45" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa0454e-da95-4174-bcab-267ab2e20718]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:17 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 Jul 03 12:48:17 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:17 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f759692f-3c9d-4d35-872a-05a7b7b70603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96204200-c982-4b7a-9be0-43a71b643e16', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf23740-707b-40b8-b789-8a1d6b4453fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Volume volume-96204200-c982-4b7a-9be0-43a71b643e16 (96204200-c982-4b7a-9be0-43a71b643e16): created successfully Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf23740-707b-40b8-b789-8a1d6b4453fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (67bf6ea6-2ee8-4d43-a4df-e43f607bd95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a099f5c8-6bb1-47b1-b172-564785961861 tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:48:18 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45" returned: 0 in 0.945s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:18 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45 Jul 03 12:48:18 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-96204200-c982-4b7a-9be0-43a71b643e16-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Lock "cinder-96204200-c982-4b7a-9be0-43a71b643e16-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-96204200-c982-4b7a-9be0-43a71b643e16" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-96204200-c982-4b7a-9be0-43a71b643e16" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e931e2c8-3485-4d77-9403-7aee9737d153]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:19 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 Jul 03 12:48:19 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:19 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9df42b52-5e8e-419d-a296-120e1186fb45" returned: 0 in 1.127s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Lock "cinder-quobyte-9df42b52-5e8e-419d-a296-120e1186fb45" released by "delete_volume" :: held 2.210s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['cb878c0d-3018-4590-8a84-cec7d29347f5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:48:19 devstack cinder-volume[86966]: WARNING cinder.quota [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1436744958 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1436744958, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Created reservations ['fc008281-b509-41cb-8cac-3a9de5aab6cf', '50ee0d48-24ba-4f17-a061-3fe66e739350', 'a80f5b21-85ec-4748-b2be-2b418794364b', 'd2a1f9c4-2a48-4577-a62f-25a41a6a0250'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:19 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:48:19 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:20 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16" returned: 0 in 1.215s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:20 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16 Jul 03 12:48:20 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:20 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.893s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:20 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:48:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-594c58b5-86a9-4250-ba5c-8a9ba4302bb9 tempest-GroupSnapshotsTest-1594135489 None] Delete group completed successfully. Jul 03 12:48:21 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-96204200-c982-4b7a-9be0-43a71b643e16" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-96204200-c982-4b7a-9be0-43a71b643e16" released by "delete_volume" :: held 2.205s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Created reservations ['6503132c-ac1e-4b83-8da7-4ac5688d450b', 'eb0b9102-5fb3-48e2-afa8-97fc3256e5b4', '3acbbac3-a175-4394-a1f2-2b0ad8f859e1', 'd55c3e7d-419f-431e-b8cc-cc415500bdef'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:21 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:48:21 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:22 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:48:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72975324-ac35-4b99-ba89-ca0235d6f16a tempest-VolumesGetTest-1222530041 None] Lock "cinder-96204200-c982-4b7a-9be0-43a71b643e16-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-82711680-9fd6-47f9-9761-78b688fda06e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Lock "cinder-82711680-9fd6-47f9-9761-78b688fda06e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-82711680-9fd6-47f9-9761-78b688fda06e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-82711680-9fd6-47f9-9761-78b688fda06e" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7822c04-269d-4d2a-ae41-604df34303d9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:22 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e Jul 03 12:48:22 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:23 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e" returned: 0 in 1.289s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:23 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e Jul 03 12:48:23 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:25 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-82711680-9fd6-47f9-9761-78b688fda06e" returned: 0 in 1.213s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-82711680-9fd6-47f9-9761-78b688fda06e" released by "delete_volume" :: held 2.586s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Created reservations ['78df6cee-bc93-4678-bb1a-45a66a436938', 'cbfb28dd-4e07-403a-971c-b7317798edd6', 'ed8fb1a4-1b52-44a9-aae2-aff4374dc5bc', '007da110-ddfc-4700-925c-55dd0565375a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:25 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:48:25 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:26 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:26 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:48:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:48:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-496c78ac-00cb-40e7-a434-a5fec0fc3eba tempest-VolumesGetTest-1222530041 None] Lock "cinder-82711680-9fd6-47f9-9761-78b688fda06e-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:48:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (893a9319-8ee9-4bf9-af87-1a178c07b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1921601-afbe-46f7-84b7-3da32d83eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1921601-afbe-46f7-84b7-3da32d83eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-520330067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe809ce-14b3-41a2-a099-932f6ab1267a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:27Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a0edb7-4e97-41cc-ac6d-5e52fe107a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a0edb7-4e97-41cc-ac6d-5e52fe107a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcdc097-9def-4a67-9376-28bb921c7603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcdc097-9def-4a67-9376-28bb921c7603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe809ce-14b3-41a2-a099-932f6ab1267a', 'volume_name': 'volume-abe809ce-14b3-41a2-a099-932f6ab1267a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b42fed-29fb-4e2e-a2e9-6242a6c5d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b42fed-29fb-4e2e-a2e9-6242a6c5d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea44b859-33b8-456f-9b1c-784309e168aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Volume abe809ce-14b3-41a2-a099-932f6ab1267a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe809ce-14b3-41a2-a099-932f6ab1267a', 'volume_size': 1} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-520330067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe809ce-14b3-41a2-a099-932f6ab1267a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:27Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Creating volume abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:48:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:27 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a 1073741824 Jul 03 12:48:27 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:28 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a 1073741824" returned: 0 in 1.255s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:28 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:48:28 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:29 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 0.855s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea44b859-33b8-456f-9b1c-784309e168aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe809ce-14b3-41a2-a099-932f6ab1267a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8f7252-4f03-4c7f-bf04-5e7790c8e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Volume volume-abe809ce-14b3-41a2-a099-932f6ab1267a (abe809ce-14b3-41a2-a099-932f6ab1267a): created successfully Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8f7252-4f03-4c7f-bf04-5e7790c8e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (893a9319-8ee9-4bf9-af87-1a178c07b546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4bc14e6a-2bac-4eb1-9a32-531524493189 tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=115,cinder:UPDATE=106,cinder:INSERT=33,cinder:DELETE=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (83b55268-46e7-4277-9bf5-37194cec8a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768eba51-7e86-40a1-a08f-28ee849810ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768eba51-7e86-40a1-a08f-28ee849810ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1767476330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2997a5e-85a0-4751-a05f-9487329c41df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=abe809ce-14b3-41a2-a099-932f6ab1267a,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:31Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e535a68-271a-44bf-82d2-a60167b5469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e535a68-271a-44bf-82d2-a60167b5469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbdb841-e144-4c9a-9f40-3faf454d47a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbdb841-e144-4c9a-9f40-3faf454d47a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f2997a5e-85a0-4751-a05f-9487329c41df', 'volume_name': 'volume-f2997a5e-85a0-4751-a05f-9487329c41df', 'volume_size': 1, 'source_volid': 'abe809ce-14b3-41a2-a099-932f6ab1267a', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57f250a-dd56-477b-8395-b0203f4ca018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57f250a-dd56-477b-8395-b0203f4ca018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a57cb7-10d0-41bd-b6fb-aae912bb756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Volume f2997a5e-85a0-4751-a05f-9487329c41df: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f2997a5e-85a0-4751-a05f-9487329c41df', 'volume_size': 1, 'source_volid': 'abe809ce-14b3-41a2-a099-932f6ab1267a', 'source_volstatus': 'available'} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Cloning volume abe809ce-14b3-41a2-a099-932f6ab1267a to volume f2997a5e-85a0-4751-a05f-9487329c41df Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Creating offline snapshot 58702253-8c88-4298-805e-e72cbfcc4884 of volume abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afeb571-5e17-4d35-8cb4-0fcc092217cc]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:31 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:48:31 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:32 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 1.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:32 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 1G Jul 03 12:48:32 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:33 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 1G" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe809ce-14b3-41a2-a099-932f6ab1267a -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:33 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe809ce-14b3-41a2-a099-932f6ab1267a -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 Jul 03 12:48:33 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:34 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe809ce-14b3-41a2-a099-932f6ab1267a -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884" returned: 0 in 1.623s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:34 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 is being set with open permissions: ugo+rw Jul 03 12:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:34 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 Jul 03 12:48:34 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:35 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:35 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info Jul 03 12:48:35 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:36 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:36 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info is being set with open permissions: ugo+rw Jul 03 12:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:36 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info Jul 03 12:48:36 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:37 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.info" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-f2997a5e-85a0-4751-a05f-9487329c41df" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-f2997a5e-85a0-4751-a05f-9487329c41df" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] snapshot: 58702253-8c88-4298-805e-e72cbfcc4884, volume: f2997a5e-85a0-4751-a05f-9487329c41df, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa83a6-1a2f-4c0e-9577-13bca173a912]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:37 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 Jul 03 12:48:37 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:38 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884" returned: 0 in 1.122s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe809ce-14b3-41a2-a099-932f6ab1267a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:48:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:48:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:48:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f9019-fe47-4f54-8440-1752e108b045]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:38 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:48:38 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:40 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 1.338s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:40 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:40 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df Jul 03 12:48:40 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-708e0c89-8af3-4676-9083-968489477450 tempest-GroupsTest-1019824431 None] Group tempest-Group1-1701955881: creating Jul 03 12:48:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-708e0c89-8af3-4676-9083-968489477450 tempest-GroupsTest-1019824431 None] Group tempest-Group1-1701955881: created successfully Jul 03 12:48:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-708e0c89-8af3-4676-9083-968489477450 tempest-GroupsTest-1019824431 None] Create group completed successfully. Jul 03 12:48:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5f658031-02cd-45c3-913f-a26b6b32281e tempest-GroupsTest-1019824431 None] Group tempest-Group2-748338519: creating Jul 03 12:48:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5f658031-02cd-45c3-913f-a26b6b32281e tempest-GroupsTest-1019824431 None] Group tempest-Group2-748338519: created successfully Jul 03 12:48:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5f658031-02cd-45c3-913f-a26b6b32281e tempest-GroupsTest-1019824431 None] Create group completed successfully. Jul 03 12:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Flow 'volume_create_manager' (58d08c92-a34b-490e-b28f-b66e49205487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e25cfa-16e2-4504-9f20-af62c3cf4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e25cfa-16e2-4504-9f20-af62c3cf4736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223687423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d082172d-93fc-488e-93ff-ff9a630293a8,host='devstack@QuobyteHD#QuobyteHD',id=7ac533a3-ab2f-43d6-980a-11fb2f2afb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854a9f24d804390b9bd463d8fe6cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:47Z,use_quota=True,user_id='28ed372c708b47d6b6808d6c75b4ff0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a85df15-0d90-48f8-8601-40948fdc9632),volume_type_id=2a85df15-0d90-48f8-8601-40948fdc9632)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d21dee-5cb3-444d-a24d-908ff0243421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d21dee-5cb3-444d-a24d-908ff0243421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c52dc5-84e2-4174-957a-5f50e499a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c52dc5-84e2-4174-957a-5f50e499a466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac533a3-ab2f-43d6-980a-11fb2f2afb5b', 'volume_name': 'volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487c0ef0-08da-4050-8064-0fcef90f3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487c0ef0-08da-4050-8064-0fcef90f3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1874f87a-57c8-4394-86a1-4eb58a0924ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Volume 7ac533a3-ab2f-43d6-980a-11fb2f2afb5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b', 'volume_size': 1} Jul 03 12:48:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:50 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df" returned: 0 in 10.093s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76c8fbf-4a8c-4e66-bb2c-f6ddc825af16]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:50 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:48:50 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:51 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 1.537s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:51 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a, size 1024.00 MB, duration 10.09 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:48:51 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Converted 1024.00 MB image at 101.45 MB/s Jul 03 12:48:51 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df is being set with open permissions: ugo+rw Jul 03 12:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:51 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df Jul 03 12:48:51 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:52 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df" returned: 0 in 0.673s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-f2997a5e-85a0-4751-a05f-9487329c41df" released by "_copy_volume_from_snapshot" :: held 14.899s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-58702253-8c88-4298-805e-e72cbfcc4884" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-58702253-8c88-4298-805e-e72cbfcc4884" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Deleting offline snapshot 58702253-8c88-4298-805e-e72cbfcc4884 of volume abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] snapshot_file for this snap is: volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64b5ce-f61c-420b-94f7-297fdd137b47]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:52 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 Jul 03 12:48:52 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:53 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884" returned: 0 in 0.844s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe809ce-14b3-41a2-a099-932f6ab1267a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:48:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e3014a-6ab4-4b28-9676-a0633371249d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:48:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:53 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:48:53 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:54 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:54 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 Jul 03 12:48:54 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:55 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:55 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884 Jul 03 12:48:55 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:55 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a.58702253-8c88-4298-805e-e72cbfcc4884" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-58702253-8c88-4298-805e-e72cbfcc4884" released by "_delete_snapshot" :: held 3.371s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.039s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.836s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d082172d-93fc-488e-93ff-ff9a630293a8,created_at=2026-07-03T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223687423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d082172d-93fc-488e-93ff-ff9a630293a8,host='devstack@QuobyteHD#QuobyteHD',id=7ac533a3-ab2f-43d6-980a-11fb2f2afb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854a9f24d804390b9bd463d8fe6cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:47Z,use_quota=True,user_id='28ed372c708b47d6b6808d6c75b4ff0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a85df15-0d90-48f8-8601-40948fdc9632),volume_type_id=2a85df15-0d90-48f8-8601-40948fdc9632)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Creating volume 7ac533a3-ab2f-43d6-980a-11fb2f2afb5b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:48:55 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a57cb7-10d0-41bd-b6fb-aae912bb756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2997a5e-85a0-4751-a05f-9487329c41df', 'volume_size': 1, 'source_volid': 'abe809ce-14b3-41a2-a099-932f6ab1267a', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:56 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b 1073741824 Jul 03 12:48:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab0dbfe-303b-4141-a9c2-72b61df6d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:56 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Volume volume-f2997a5e-85a0-4751-a05f-9487329c41df (f2997a5e-85a0-4751-a05f-9487329c41df): created successfully Jul 03 12:48:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab0dbfe-303b-4141-a9c2-72b61df6d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (83b55268-46e7-4277-9bf5-37194cec8a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8b6fd24f-31d7-486c-976d-f1e20d92c6d7 tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:48:58 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (805e543e-d8e4-4802-b027-bc0c58ffbf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bf9a82-6c5c-418f-b251-d268b9e9d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b 1073741824" returned: 0 in 2.236s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bf9a82-6c5c-418f-b251-d268b9e9d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-297645643',display_name='tempest-VolumesGetTest-Volume-35099938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445562fe-d9e4-4de3-829b-790fe2dcd540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:58Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a909fa2b-51d3-4a2b-a33a-8c1f4f2d1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a909fa2b-51d3-4a2b-a33a-8c1f4f2d1366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662ba5da-faba-45ab-82d0-2c46164495ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662ba5da-faba-45ab-82d0-2c46164495ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445562fe-d9e4-4de3-829b-790fe2dcd540', 'volume_name': 'volume-445562fe-d9e4-4de3-829b-790fe2dcd540', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb64ea6-ded5-4349-8622-1f0314a8657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb64ea6-ded5-4349-8622-1f0314a8657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da97ef50-aced-4c0e-a430-0af4211f4a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Volume 445562fe-d9e4-4de3-829b-790fe2dcd540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445562fe-d9e4-4de3-829b-790fe2dcd540', 'volume_size': 1} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:58 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b Jul 03 12:48:58 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:59 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b" returned: 0 in 1.356s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] <== create_volume: return (3790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.795s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.399s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:48:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-297645643',display_name='tempest-VolumesGetTest-Volume-35099938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445562fe-d9e4-4de3-829b-790fe2dcd540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:58Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Creating volume 445562fe-d9e4-4de3-829b-790fe2dcd540 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:48:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1874f87a-57c8-4394-86a1-4eb58a0924ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:59 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 1073741824 Jul 03 12:48:59 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95201ff4-1d56-42d1-9f3f-96991e6259d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:48:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Volume volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b (7ac533a3-ab2f-43d6-980a-11fb2f2afb5b): created successfully Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95201ff4-1d56-42d1-9f3f-96991e6259d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Flow 'volume_create_manager' (58d08c92-a34b-490e-b28f-b66e49205487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:48:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3c3f2b2d-d454-4d2e-a888-cb3ab37081a2 tempest-GroupsTest-1019824431 None] Created volume successfully. Jul 03 12:49:01 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 1073741824" returned: 0 in 1.474s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=52,cinder:UPDATE=72,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:01 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 Jul 03 12:49:01 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Acquiring lock "cinder-quobyte-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Lock "cinder-quobyte-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[360088c7-b403-4d41-b681-72405e5ce50b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:01 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b Jul 03 12:49:01 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:01 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:01 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:02 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540" returned: 0 in 0.989s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] <== create_volume: return (2553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.559s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Flow 'volume_create_manager' (5ffb71f2-c948-45e2-bb64-253f0c0e5868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d46fffd-7c20-4c4d-95bd-b1e9c9ff127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da97ef50-aced-4c0e-a430-0af4211f4a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445562fe-d9e4-4de3-829b-790fe2dcd540', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f449a4c-f0c1-4c3f-81d8-440ad11a890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d46fffd-7c20-4c4d-95bd-b1e9c9ff127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-665275944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264a4cc8-77ff-4c53-b0b0-dee3c3671635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43811ae5b5c4bcd8be311fc92b10f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:02Z,use_quota=True,user_id='70a46878012745b9af28f96926154bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b229d468-1863-418d-bc3b-1cbe646ebb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b229d468-1863-418d-bc3b-1cbe646ebb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ab6ca7-9d4e-48d7-8b99-6435048d7287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ab6ca7-9d4e-48d7-8b99-6435048d7287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264a4cc8-77ff-4c53-b0b0-dee3c3671635', 'volume_name': 'volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4faeab8-478b-4bd0-a0f6-71410edfccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4faeab8-478b-4bd0-a0f6-71410edfccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38b6e10-9f3c-4f8d-b03a-8b7ee94e8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Volume 264a4cc8-77ff-4c53-b0b0-dee3c3671635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635', 'volume_size': 1} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-665275944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264a4cc8-77ff-4c53-b0b0-dee3c3671635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43811ae5b5c4bcd8be311fc92b10f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:02Z,use_quota=True,user_id='70a46878012745b9af28f96926154bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Creating volume 264a4cc8-77ff-4c53-b0b0-dee3c3671635 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Volume volume-445562fe-d9e4-4de3-829b-790fe2dcd540 (445562fe-d9e4-4de3-829b-790fe2dcd540): created successfully Jul 03 12:49:02 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 1073741824 Jul 03 12:49:02 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f449a4c-f0c1-4c3f-81d8-440ad11a890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (805e543e-d8e4-4802-b027-bc0c58ffbf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5a7fcab6-005e-4c0e-98ff-7f50bff116c4 tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:49:02 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b" returned: 0 in 1.290s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:02 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b Jul 03 12:49:02 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:02 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.953s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:03 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b" returned: 0 in 0.821s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Lock "cinder-quobyte-7ac533a3-ab2f-43d6-980a-11fb2f2afb5b" released by "delete_volume" :: held 2.201s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:03 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 1073741824" returned: 0 in 1.146s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:03 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 Jul 03 12:49:03 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Created reservations ['72571086-5340-4fb2-89e6-c7000d446468'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:03 devstack cinder-volume[86966]: WARNING cinder.quota [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1384326229 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1384326229, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:49:03 devstack cinder-volume[86966]: WARNING cinder.quota [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1384326229 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1384326229, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Created reservations ['8fcb9e77-6e97-4b58-b01e-41585fbe73f7', 'e90348ac-b9b0-4d63-af1f-f5615e2956c5', '0c8795ba-87b4-4875-9d8b-6c040c68ba18', '2b25c055-e461-4f66-8a96-8e6cb4b11515'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-445562fe-d9e4-4de3-829b-790fe2dcd540-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Lock "cinder-445562fe-d9e4-4de3-829b-790fe2dcd540-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-445562fe-d9e4-4de3-829b-790fe2dcd540" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-445562fe-d9e4-4de3-829b-790fe2dcd540" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c2e8c-b318-421f-a84f-ea75bcce3bbb]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:04 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:04 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:04 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 Jul 03 12:49:04 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:04 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38b6e10-9f3c-4f8d-b03a-8b7ee94e8e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7d169c-bfbe-4ef7-a6d6-9f76e9c7b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Volume volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 (264a4cc8-77ff-4c53-b0b0-dee3c3671635): created successfully Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7d169c-bfbe-4ef7-a6d6-9f76e9c7b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Flow 'volume_create_manager' (5ffb71f2-c948-45e2-bb64-253f0c0e5868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-afcfec76-876a-47b1-a894-57c30fb299bf tempest-AttachVolumeNegativeTest-29985512 None] Created volume successfully. Jul 03 12:49:04 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.734s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:04 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f12ea906-05c1-4744-9b13-bc8d1058e9ba tempest-GroupsTest-1019824431 None] Delete group completed successfully. Jul 03 12:49:05 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540" returned: 0 in 0.923s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:05 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540 Jul 03 12:49:05 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Created reservations ['9a500b17-4a99-4825-b6ec-43a7f98c5fc4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:05 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:05 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:05 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-445562fe-d9e4-4de3-829b-790fe2dcd540" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-445562fe-d9e4-4de3-829b-790fe2dcd540" released by "delete_volume" :: held 1.735s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Created reservations ['7d018a36-4817-4c92-a30c-6eb45c542bab', '2e7581ca-964a-473a-b4ab-8e0769f1cd67', 'e46ca164-f0de-4b91-9bb7-46ae20934bda', 'c4e51fd0-0ac1-4b0c-a237-3c76303b43f3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:05 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:05 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:06 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-efe04e16-ebed-4e70-9b09-a398945a2a73 tempest-GroupsTest-1019824431 None] Delete group completed successfully. Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-f2997a5e-85a0-4751-a05f-9487329c41df-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Lock "cinder-f2997a5e-85a0-4751-a05f-9487329c41df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-f2997a5e-85a0-4751-a05f-9487329c41df" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-f2997a5e-85a0-4751-a05f-9487329c41df" acquired by "delete_volume" :: waited 0.054s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[54918b5b-a5a2-4743-a37a-5fd421a00674]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:06 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df Jul 03 12:49:06 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:07 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.599s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:07 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:49:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a23180d-23d2-4f6b-b382-8ee9f7a506d9 tempest-VolumesGetTest-1222530041 None] Lock "cinder-445562fe-d9e4-4de3-829b-790fe2dcd540-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cdb83053-aa76-4003-9f4c-ba750b2a9b2b tempest-GroupsTest-1019824431 None] Group tempest-GroupsTest-Group-670796745: creating Jul 03 12:49:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cdb83053-aa76-4003-9f4c-ba750b2a9b2b tempest-GroupsTest-1019824431 None] Group tempest-GroupsTest-Group-670796745: created successfully Jul 03 12:49:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cdb83053-aa76-4003-9f4c-ba750b2a9b2b tempest-GroupsTest-1019824431 None] Create group completed successfully. Jul 03 12:49:08 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df" returned: 0 in 1.524s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:08 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df Jul 03 12:49:08 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f879752-0dc7-486b-bef9-abe00e144b2e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:09 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 Jul 03 12:49:09 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:09 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f2997a5e-85a0-4751-a05f-9487329c41df" returned: 0 in 1.228s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-f2997a5e-85a0-4751-a05f-9487329c41df" released by "delete_volume" :: held 2.826s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Created reservations ['375529a3-701d-4cf0-a102-62267b37b13e', '9ea45dcc-851e-4483-9bd2-a89e428db529', '92883aa5-d79f-41e1-ba5d-88ddc62f2594', 'ccaceaee-0b07-462b-a4af-5d3292096475'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:09 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:09 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:10 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Flow 'volume_create_manager' (78b93d47-f4cd-4c76-a086-2f118430f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aefdb4a-45ed-46a3-81fe-2af9ca5d6ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635" returned: 0 in 1.552s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.594s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aefdb4a-45ed-46a3-81fe-2af9ca5d6ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1454508074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aeb41f7a-0b71-4008-bdf8-a78cfee30859,host='devstack@QuobyteHD#QuobyteHD',id=d33154f0-bec0-4972-8773-a12edd3da3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854a9f24d804390b9bd463d8fe6cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:10Z,use_quota=True,user_id='28ed372c708b47d6b6808d6c75b4ff0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(751577af-dc94-475b-8180-f87af6e0ad83),volume_type_id=751577af-dc94-475b-8180-f87af6e0ad83)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa976245-1ddc-4b8b-b3c9-aaf1ec5dc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa976245-1ddc-4b8b-b3c9-aaf1ec5dc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f50184-d43a-4316-8363-a02a8d161036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f50184-d43a-4316-8363-a02a8d161036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33154f0-bec0-4972-8773-a12edd3da3a6', 'volume_name': 'volume-d33154f0-bec0-4972-8773-a12edd3da3a6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79eb1be6-842b-44a7-b172-7e9dc42b0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79eb1be6-842b-44a7-b172-7e9dc42b0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6963fff-cee4-4cc4-bb7b-7b70d75252cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Volume d33154f0-bec0-4972-8773-a12edd3da3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33154f0-bec0-4972-8773-a12edd3da3a6', 'volume_size': 1} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aeb41f7a-0b71-4008-bdf8-a78cfee30859,created_at=2026-07-03T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1454508074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aeb41f7a-0b71-4008-bdf8-a78cfee30859,host='devstack@QuobyteHD#QuobyteHD',id=d33154f0-bec0-4972-8773-a12edd3da3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854a9f24d804390b9bd463d8fe6cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:10Z,use_quota=True,user_id='28ed372c708b47d6b6808d6c75b4ff0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(751577af-dc94-475b-8180-f87af6e0ad83),volume_type_id=751577af-dc94-475b-8180-f87af6e0ad83)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Creating volume d33154f0-bec0-4972-8773-a12edd3da3a6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:10 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81b612d1-fe04-4ae1-b474-618e76faf4c1', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:49:10 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 1073741824 Jul 03 12:49:10 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4ab39c80-05d7-4867-afd4-c5b12cf56eca req-df0c8b71-1f93-4c48-b212-da47b9acd0ec tempest-AttachVolumeNegativeTest-29985512 None] attachment_update completed successfully. Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-abe809ce-14b3-41a2-a099-932f6ab1267a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Lock "cinder-abe809ce-14b3-41a2-a099-932f6ab1267a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-abe809ce-14b3-41a2-a099-932f6ab1267a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-abe809ce-14b3-41a2-a099-932f6ab1267a" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f91db34-e19b-432d-b02c-1418a6354733]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:11 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:49:11 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:11 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.525s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:49:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-294d9c4b-6cc2-4214-aa73-704465adac61 tempest-VolumesGetTest-1222530041 None] Lock "cinder-f2997a5e-85a0-4751-a05f-9487329c41df-delete_volume" released by "delete_volume" :: held 4.829s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:12 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 1.218s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:12 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a Jul 03 12:49:12 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:12 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 1073741824" returned: 0 in 1.910s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:12 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 Jul 03 12:49:12 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:13 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-abe809ce-14b3-41a2-a099-932f6ab1267a" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-abe809ce-14b3-41a2-a099-932f6ab1267a" released by "delete_volume" :: held 2.293s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Created reservations ['ac97d02f-fe0c-4c14-b8e5-cf3100afa815', '786bd450-ba47-4737-837d-8bc92c155705', '4dc900a9-0138-432e-b6d3-460ad2396679', '8c5a8d45-bb30-4429-81ff-f5e17e8a21d6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:13 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] <== create_volume: return (2821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.824s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6963fff-cee4-4cc4-bb7b-7b70d75252cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33154f0-bec0-4972-8773-a12edd3da3a6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f720c0f-b54c-4480-a321-8648e21a485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Volume volume-d33154f0-bec0-4972-8773-a12edd3da3a6 (d33154f0-bec0-4972-8773-a12edd3da3a6): created successfully Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f720c0f-b54c-4480-a321-8648e21a485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Flow 'volume_create_manager' (78b93d47-f4cd-4c76-a086-2f118430f54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2239f7ee-dcb5-4f38-a5c0-43b804b6ce94 tempest-GroupsTest-1019824431 None] Created volume successfully. Jul 03 12:49:13 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:13 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:14 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:49:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff9c327a-d19c-45c9-91ff-4d5e706fb203 tempest-VolumesGetTest-1222530041 None] Lock "cinder-abe809ce-14b3-41a2-a099-932f6ab1267a-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Flow 'volume_create_manager' (461bb9d7-9bef-43e8-b1fa-c81eb9d80340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de04ca0d-93bd-4574-9b1f-334cb4472726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de04ca0d-93bd-4574-9b1f-334cb4472726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-875297190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aeb41f7a-0b71-4008-bdf8-a78cfee30859,host='devstack@QuobyteHD#QuobyteHD',id=260c9098-9b6b-4950-a238-f52691498947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854a9f24d804390b9bd463d8fe6cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:15Z,use_quota=True,user_id='28ed372c708b47d6b6808d6c75b4ff0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(751577af-dc94-475b-8180-f87af6e0ad83),volume_type_id=751577af-dc94-475b-8180-f87af6e0ad83)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5927bafa-53ef-4dc6-bd02-24389a52bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5927bafa-53ef-4dc6-bd02-24389a52bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df595b6-342e-40c4-a198-bba52a43ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df595b6-342e-40c4-a198-bba52a43ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260c9098-9b6b-4950-a238-f52691498947', 'volume_name': 'volume-260c9098-9b6b-4950-a238-f52691498947', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41af748f-716b-451d-8b05-dce57d9f94fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41af748f-716b-451d-8b05-dce57d9f94fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ee83db-399f-456f-9c53-6a74dc17225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Volume 260c9098-9b6b-4950-a238-f52691498947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260c9098-9b6b-4950-a238-f52691498947', 'volume_size': 1} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aeb41f7a-0b71-4008-bdf8-a78cfee30859,created_at=2026-07-03T10:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-875297190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aeb41f7a-0b71-4008-bdf8-a78cfee30859,host='devstack@QuobyteHD#QuobyteHD',id=260c9098-9b6b-4950-a238-f52691498947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854a9f24d804390b9bd463d8fe6cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:15Z,use_quota=True,user_id='28ed372c708b47d6b6808d6c75b4ff0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(751577af-dc94-475b-8180-f87af6e0ad83),volume_type_id=751577af-dc94-475b-8180-f87af6e0ad83)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Creating volume 260c9098-9b6b-4950-a238-f52691498947 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:15 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 1073741824 Jul 03 12:49:15 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (f021a9ff-88e5-4b99-b2d2-e7e1a24488bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a67898-3f33-4187-85c5-bc2bf45bee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a67898-3f33-4187-85c5-bc2bf45bee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-580251130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057675fe-03bd-40aa-b959-a5da09f3d4b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:16Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c59be7-c355-4ce2-918f-9d54498a38ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c59be7-c355-4ce2-918f-9d54498a38ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de7e01-3d63-40c8-9434-0e21e474eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:15 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 12:49:16 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 1073741824" returned: 0 in 1.083s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:16 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 Jul 03 12:49:16 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de7e01-3d63-40c8-9434-0e21e474eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '057675fe-03bd-40aa-b959-a5da09f3d4b6', 'volume_name': 'volume-057675fe-03bd-40aa-b959-a5da09f3d4b6', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d5c74b-b1e8-48f1-a2c1-1e31a83bef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d5c74b-b1e8-48f1-a2c1-1e31a83bef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfc0779-6db1-440e-abd8-532ccd499a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Volume 057675fe-03bd-40aa-b959-a5da09f3d4b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-057675fe-03bd-40aa-b959-a5da09f3d4b6', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Trying to clone 057675fe-03bd-40aa-b959-a5da09f3d4b6 from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 12:49:16 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Image download 20.69 MB at 20.69 MB/s Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e6c0e-ff9e-4300-8dd7-67d65243d07f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:17 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD Jul 03 12:49:17 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:17 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947" returned: 0 in 0.789s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ee83db-399f-456f-9c53-6a74dc17225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260c9098-9b6b-4950-a238-f52691498947', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23214225-69e4-4240-9969-8ae1a09fdced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Volume volume-260c9098-9b6b-4950-a238-f52691498947 (260c9098-9b6b-4950-a238-f52691498947): created successfully Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23214225-69e4-4240-9969-8ae1a09fdced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Flow 'volume_create_manager' (461bb9d7-9bef-43e8-b1fa-c81eb9d80340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-83ee2986-c6e0-4c31-8028-0b3e7f8df873 tempest-GroupsTest-1019824431 None] Created volume successfully. Jul 03 12:49:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-fe26f23b-8200-4067-b4d9-7b13e8994225 req-0b82bb05-80d6-43b2-89d2-cedf0147863d tempest-AttachVolumeNegativeTest-29985512 None] Terminate volume connection completed successfully. Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-fe26f23b-8200-4067-b4d9-7b13e8994225 req-0b82bb05-80d6-43b2-89d2-cedf0147863d tempest-AttachVolumeNegativeTest-29985512 None] Deleting attachment 81b612d1-fe04-4ae1-b474-618e76faf4c1. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:49:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6bd27725-007e-4ef1-bec4-00dc442f3171 tempest-GroupsTest-1019824431 None] Update group completed successfully. Jul 03 12:49:17 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD" returned: 0 in 0.950s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:17 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b is fetched for user 6b66217f188744e0ae4ee6218030ccfc. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[222985e0-5a49-48e6-aa6d-d4153d86b71e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:18 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD Jul 03 12:49:18 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Flow 'volume_create_manager' (729481e9-09a7-4e3f-89d4-61c55bbf1384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875c6ab8-b12b-4b7a-855e-73fae644bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875c6ab8-b12b-4b7a-855e-73fae644bb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-767323283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b465ee0b-a038-492b-9dc1-513fb138e71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34fd28e3dbb42d8a755ebaa2afacb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:19Z,use_quota=True,user_id='1be9514daabf4faba30fe47720447112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d69b8bb-06a2-432d-ad2b-90c5542d16aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d69b8bb-06a2-432d-ad2b-90c5542d16aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4585ab-9141-4002-8fef-f1f22b14e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4585ab-9141-4002-8fef-f1f22b14e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b465ee0b-a038-492b-9dc1-513fb138e71f', 'volume_name': 'volume-b465ee0b-a038-492b-9dc1-513fb138e71f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba70d5e0-b48c-4bde-9056-c39e47080403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba70d5e0-b48c-4bde-9056-c39e47080403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5315a55b-61a6-484a-a510-c1e56b3ec877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Volume b465ee0b-a038-492b-9dc1-513fb138e71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b465ee0b-a038-492b-9dc1-513fb138e71f', 'volume_size': 1} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-767323283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b465ee0b-a038-492b-9dc1-513fb138e71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34fd28e3dbb42d8a755ebaa2afacb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:19Z,use_quota=True,user_id='1be9514daabf4faba30fe47720447112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Creating volume b465ee0b-a038-492b-9dc1-513fb138e71f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:18 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f 1073741824 Jul 03 12:49:18 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:18 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fb299d20-8a52-42f4-b118-260e57ab304a tempest-GroupsTest-1019824431 None] Update group completed successfully. Jul 03 12:49:19 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f 1073741824" returned: 0 in 1.072s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:19 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f Jul 03 12:49:19 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:20 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-580251130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057675fe-03bd-40aa-b959-a5da09f3d4b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:16Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Creating volume 057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:20 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:20 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 1073741824 Jul 03 12:49:20 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5315a55b-61a6-484a-a510-c1e56b3ec877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b465ee0b-a038-492b-9dc1-513fb138e71f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83255bf-8037-4634-b771-a094fb035f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Volume volume-b465ee0b-a038-492b-9dc1-513fb138e71f (b465ee0b-a038-492b-9dc1-513fb138e71f): created successfully Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83255bf-8037-4634-b771-a094fb035f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Flow 'volume_create_manager' (729481e9-09a7-4e3f-89d4-61c55bbf1384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fbee8a91-a792-47fb-b51e-5960dcb786de tempest-ServersNegativeTestJSON-274101717 None] Created volume successfully. Jul 03 12:49:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Acquiring lock "cinder-quobyte-260c9098-9b6b-4950-a238-f52691498947" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Lock "cinder-quobyte-260c9098-9b6b-4950-a238-f52691498947" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ddbb9-c2cc-4cb5-a4b1-8381fa54e637]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:21 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 Jul 03 12:49:21 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:22 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 1073741824" returned: 0 in 1.566s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:22 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:22 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:22 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947" returned: 0 in 1.216s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:22 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947 Jul 03 12:49:22 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:23 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 0 in 1.080s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] <== create_volume: return (2710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.717s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Attempting download of 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume 057675fe-03bd-40aa-b959-a5da09f3d4b6. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909d79d-8e35-4c48-b8cf-23c7e6d5296b]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:23 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5 Jul 03 12:49:23 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:23 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-260c9098-9b6b-4950-a238-f52691498947" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Lock "cinder-quobyte-260c9098-9b6b-4950-a238-f52691498947" released by "delete_volume" :: held 2.377s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Acquiring lock "cinder-quobyte-d33154f0-bec0-4972-8773-a12edd3da3a6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Lock "cinder-quobyte-d33154f0-bec0-4972-8773-a12edd3da3a6" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29020f7-c46d-44f1-94e0-fe6e5531f8ad]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:24 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 Jul 03 12:49:24 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Flow 'volume_create_manager' (74474b89-4941-40b6-a8c0-2f54ec9bd32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c563130-0757-4fbf-acd8-f56368b8eb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c563130-0757-4fbf-acd8-f56368b8eb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1056068448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c1592a-5150-4326-bdaf-3d71e16d61c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34fd28e3dbb42d8a755ebaa2afacb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:24Z,use_quota=True,user_id='1be9514daabf4faba30fe47720447112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf742dea-be4e-4763-9c8b-c192de17cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf742dea-be4e-4763-9c8b-c192de17cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31c2bec-2a9d-45fc-a755-9a3b660374f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31c2bec-2a9d-45fc-a755-9a3b660374f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c1592a-5150-4326-bdaf-3d71e16d61c9', 'volume_name': 'volume-24c1592a-5150-4326-bdaf-3d71e16d61c9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac11a8e7-de36-444b-a66a-9e0bbecffc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac11a8e7-de36-444b-a66a-9e0bbecffc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e90441-936d-435d-b2a1-3fa84faaf729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Volume 24c1592a-5150-4326-bdaf-3d71e16d61c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c1592a-5150-4326-bdaf-3d71e16d61c9', 'volume_size': 1} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1056068448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c1592a-5150-4326-bdaf-3d71e16d61c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34fd28e3dbb42d8a755ebaa2afacb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:24Z,use_quota=True,user_id='1be9514daabf4faba30fe47720447112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Creating volume 24c1592a-5150-4326-bdaf-3d71e16d61c9 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:24 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:24 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 1073741824 Jul 03 12:49:24 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:24 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5" returned: 0 in 1.202s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:24 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5 Jul 03 12:49:24 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:24 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6" returned: 0 in 0.979s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:24 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6 Jul 03 12:49:24 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:25 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 1073741824" returned: 0 in 1.097s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:25 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 Jul 03 12:49:25 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:25 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5" returned: 1 in 1.070s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_zpzjnmy5' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498dd3e-9e9f-40d5-beeb-c3571e22c8a6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:25 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d33154f0-bec0-4972-8773-a12edd3da3a6" returned: 0 in 0.898s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Lock "cinder-quobyte-d33154f0-bec0-4972-8773-a12edd3da3a6" released by "delete_volume" :: held 1.980s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:25 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD Jul 03 12:49:25 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Created reservations ['1490a728-386f-40ff-9b46-7bdd05e0ceaf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:25 devstack cinder-volume[86966]: WARNING cinder.quota [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2009774785 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2009774785, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:49:25 devstack cinder-volume[86966]: WARNING cinder.quota [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2009774785 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2009774785, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:49:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Created reservations ['1290f5f9-402d-4857-8de0-7260344b46fc', '5c848c29-6ea5-4b9a-8f6e-18f7fbb581f0', '8538e548-7b91-4160-8ff7-9dbd27780d8b', '93629d75-dc1a-487b-861b-23e15367bd1e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Created reservations ['04b898ab-ff1a-4139-a0e8-8f3022e37e97', 'c5fb6f86-0d28-4f2d-9543-6562c7e7ec50', 'caf2e6de-547e-4b3f-9dff-4d967df0bd27', '0b864666-3568-4c7e-a825-eb53485f89d7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:26 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:26 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:26 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e90441-936d-435d-b2a1-3fa84faaf729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c1592a-5150-4326-bdaf-3d71e16d61c9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8862ada-52a8-472b-83fa-c979d88665a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Volume volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 (24c1592a-5150-4326-bdaf-3d71e16d61c9): created successfully Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8862ada-52a8-472b-83fa-c979d88665a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Flow 'volume_create_manager' (74474b89-4941-40b6-a8c0-2f54ec9bd32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f67739d8-887f-41da-a07d-e09e8a49f36f tempest-ServersNegativeTestJSON-274101717 None] Created volume successfully. Jul 03 12:49:26 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] 8afb0fcf-aee7-4200-b86c-2c05ba162c4b was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:26 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:26 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:26 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:26 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f986aaee-2b26-4de4-b696-183c5f721c8f tempest-GroupsTest-1019824431 None] Delete group completed successfully. Jul 03 12:49:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "cinder-24c1592a-5150-4326-bdaf-3d71e16d61c9-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-24c1592a-5150-4326-bdaf-3d71e16d61c9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "cinder-quobyte-24c1592a-5150-4326-bdaf-3d71e16d61c9" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-quobyte-24c1592a-5150-4326-bdaf-3d71e16d61c9" acquired by "delete_volume" :: waited 0.043s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b2d03-a707-4f50-81be-90db624a720e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:28 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 Jul 03 12:49:28 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "cinder-264a4cc8-77ff-4c53-b0b0-dee3c3671635-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-264a4cc8-77ff-4c53-b0b0-dee3c3671635-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "cinder-quobyte-264a4cc8-77ff-4c53-b0b0-dee3c3671635" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-quobyte-264a4cc8-77ff-4c53-b0b0-dee3c3671635" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[956de88d-0815-4f07-ab9a-e0e1976cd552]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:29 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9" returned: 0 in 1.386s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:29 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 Jul 03 12:49:29 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:29 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9 Jul 03 12:49:29 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:29 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 0 in 3.176s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_kugmr475devstack@QuobyteHD, size 112.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:49:29 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Converted 112.00 MB image at 35.23 MB/s Jul 03 12:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:29 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 1G Jul 03 12:49:29 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:30 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-24c1592a-5150-4326-bdaf-3d71e16d61c9" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-quobyte-24c1592a-5150-4326-bdaf-3d71e16d61c9" released by "delete_volume" :: held 2.329s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:30 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635" returned: 0 in 1.110s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:30 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635 Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Created reservations ['43fca253-6f6c-4802-9bac-3b096f8c1bcc', 'a8486ce2-3b5c-464e-a5bb-01ff07598e65', 'e3afd7da-bccc-4cce-9535-4d1bb0d6e69c', '5b04f57e-faf7-4258-8dca-39b406cc1864'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:30 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:30 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:30 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:31 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 1G" returned: 0 in 1.252s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fd16ef-5518-4e4e-a7ee-8399a0d67339]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:31 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:31 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "cinder-b465ee0b-a038-492b-9dc1-513fb138e71f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-b465ee0b-a038-492b-9dc1-513fb138e71f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=98,cinder:INSERT=23,cinder:UPDATE=93,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "cinder-quobyte-b465ee0b-a038-492b-9dc1-513fb138e71f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-quobyte-b465ee0b-a038-492b-9dc1-513fb138e71f" acquired by "delete_volume" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:31 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-264a4cc8-77ff-4c53-b0b0-dee3c3671635" returned: 0 in 1.318s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a86e9-5811-4b55-8b77-0a1b510da527]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-quobyte-264a4cc8-77ff-4c53-b0b0-dee3c3671635" released by "delete_volume" :: held 2.514s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Created reservations ['f2c3e03c-252c-46ee-962f-2353bada3c96', '56b2a90f-f8da-44cd-a7a4-2f55b53359c9', '0e193999-b5c5-4818-ac55-b1bcdff942a3', '1cff76c4-46e0-45ac-b74e-79f669c90936'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:31 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:32 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f Jul 03 12:49:32 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.351s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Deleted volume successfully. Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c393f4b9-c946-4c11-b0ea-15c6edc8e71b tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-24c1592a-5150-4326-bdaf-3d71e16d61c9-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:32 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:32 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:32 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 0 in 1.530s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:32 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:32 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:32 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f" returned: 0 in 1.126s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:32 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f Jul 03 12:49:32 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:33 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.910s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Deleted volume successfully. Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1836d51c-99af-4f33-9f50-a5fde5c4cc07 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-264a4cc8-77ff-4c53-b0b0-dee3c3671635-delete_volume" released by "delete_volume" :: held 3.865s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "cinder-f36d77ee-23f9-4fba-b08d-35e43707b67a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-f36d77ee-23f9-4fba-b08d-35e43707b67a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "cinder-quobyte-f36d77ee-23f9-4fba-b08d-35e43707b67a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-quobyte-f36d77ee-23f9-4fba-b08d-35e43707b67a" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e534dcf4-e740-477c-87df-b7bad769ad6b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:33 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a Jul 03 12:49:33 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:33 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 1 in 1.048s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Downloaded image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume 057675fe-03bd-40aa-b959-a5da09f3d4b6 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b for user 6b66217f188744e0ae4ee6218030ccfc is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Marking volume 057675fe-03bd-40aa-b959-a5da09f3d4b6 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Copying metadata from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b to 057675fe-03bd-40aa-b959-a5da09f3d4b6. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Creating volume glance metadata for volume 057675fe-03bd-40aa-b959-a5da09f3d4b6 backed by image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 12:49:33 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfc0779-6db1-440e-abd8-532ccd499a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057675fe-03bd-40aa-b959-a5da09f3d4b6', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef75eb72-01d9-4082-acf9-adcafa4760e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b465ee0b-a038-492b-9dc1-513fb138e71f" returned: 0 in 1.012s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-quobyte-b465ee0b-a038-492b-9dc1-513fb138e71f" released by "delete_volume" :: held 2.227s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Volume volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 (057675fe-03bd-40aa-b959-a5da09f3d4b6): created successfully Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef75eb72-01d9-4082-acf9-adcafa4760e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (f021a9ff-88e5-4b99-b2d2-e7e1a24488bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dcfd6785-030c-4a5c-a626-e5ac5710de25 tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Created reservations ['4bd4eff2-0dc2-4350-b4ed-bca4ea00bb95', 'a119c6a2-f551-47b8-b580-4bb45be51b15', '1d91a1e1-32ad-4d32-948a-b6968840835c', '42cce080-f0d2-40a7-9a8a-36a4365bba8d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:34 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:34 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:34 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a" returned: 0 in 1.016s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:34 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a Jul 03 12:49:34 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:34 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.823s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Deleted volume successfully. Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fdae23ea-1afb-45ed-809a-a3462a4952cc tempest-ServersNegativeTestJSON-274101717 None] Lock "cinder-b465ee0b-a038-492b-9dc1-513fb138e71f-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (f52e84e3-a718-4386-b3f6-1edbad9ab105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7c814f-0782-499b-8ade-36f93d61f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:35 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7c814f-0782-499b-8ade-36f93d61f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-98238223',display_name='tempest-VolumesGetTest-Volume-292489340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27882c98-bfea-4348-8e1c-45b3e68d4dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:36Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dde4acd-904b-4cd5-8727-e6efbcb15529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dde4acd-904b-4cd5-8727-e6efbcb15529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81196c3-8cb3-4672-a1aa-fceb36fd1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81196c3-8cb3-4672-a1aa-fceb36fd1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27882c98-bfea-4348-8e1c-45b3e68d4dd2', 'volume_name': 'volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1957d7d-844b-406e-a1ad-466b091a3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1957d7d-844b-406e-a1ad-466b091a3627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7367fd8d-9b38-463b-a5cd-245764442eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Volume 27882c98-bfea-4348-8e1c-45b3e68d4dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2', 'volume_size': 1} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-98238223',display_name='tempest-VolumesGetTest-Volume-292489340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27882c98-bfea-4348-8e1c-45b3e68d4dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2226474d08984b56b3ed8ccd99ba6f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:36Z,use_quota=True,user_id='6b66217f188744e0ae4ee6218030ccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Creating volume 27882c98-bfea-4348-8e1c-45b3e68d4dd2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f36d77ee-23f9-4fba-b08d-35e43707b67a" returned: 0 in 1.208s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:35 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 1073741824 Jul 03 12:49:35 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-quobyte-f36d77ee-23f9-4fba-b08d-35e43707b67a" released by "delete_volume" :: held 2.295s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Created reservations ['dc69d7e7-7e4a-4559-a995-09bb49c7fdee', '0ee1a646-fb90-4f99-9d88-678113e6f75e', '4a4986c1-bb9e-4ef7-8e20-d3e698102159', '7c2f2f9c-896e-4546-9ef7-c795b1d862b4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:36 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:36 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:37 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.052s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Deleted volume successfully. Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e69bdab-bffd-49c4-93f6-16058a11e743 tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-f36d77ee-23f9-4fba-b08d-35e43707b67a-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "cinder-c9cc4e2b-08af-43c7-96f7-8abf958d892b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:37 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 1073741824" returned: 0 in 1.658s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-c9cc4e2b-08af-43c7-96f7-8abf958d892b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:37 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 Jul 03 12:49:37 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "cinder-quobyte-c9cc4e2b-08af-43c7-96f7-8abf958d892b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Flow 'volume_create_manager' (850a3df7-4de7-4db8-8bec-987f42618c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6926cb-dd42-431f-8ebe-a9a019a2a3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-quobyte-c9cc4e2b-08af-43c7-96f7-8abf958d892b" acquired by "delete_volume" :: waited 0.115s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6926cb-dd42-431f-8ebe-a9a019a2a3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706533399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b1316f-7d0b-4e92-b5e2-729cb6458540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c791777f0b124904b6da9697c5d2d72f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:37Z,use_quota=True,user_id='9a2d30d6ae1a43a5bc614ab1dc627f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276a6313-0556-40e4-aa2a-b6f4b1f5e310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276a6313-0556-40e4-aa2a-b6f4b1f5e310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee0fbbc-9fc0-4a74-afbb-66c83f04e9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee0fbbc-9fc0-4a74-afbb-66c83f04e9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b1316f-7d0b-4e92-b5e2-729cb6458540', 'volume_name': 'volume-65b1316f-7d0b-4e92-b5e2-729cb6458540', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6cdc7f-d7ae-4195-9994-eeab471966c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6cdc7f-d7ae-4195-9994-eeab471966c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604f72f2-4119-4b50-ab06-5822fef497b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Volume 65b1316f-7d0b-4e92-b5e2-729cb6458540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b1316f-7d0b-4e92-b5e2-729cb6458540', 'volume_size': 1} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abce57c-c0ae-433c-8b78-d90e36b32c84]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:37 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b Jul 03 12:49:37 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:38 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] <== create_volume: return (2547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.550s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706533399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b1316f-7d0b-4e92-b5e2-729cb6458540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c791777f0b124904b6da9697c5d2d72f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:37Z,use_quota=True,user_id='9a2d30d6ae1a43a5bc614ab1dc627f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Creating volume 65b1316f-7d0b-4e92-b5e2-729cb6458540 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:38 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:38 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 1073741824 Jul 03 12:49:38 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7367fd8d-9b38-463b-a5cd-245764442eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5390f61e-fdce-4f21-87ac-87109cd9bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Volume volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 (27882c98-bfea-4348-8e1c-45b3e68d4dd2): created successfully Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5390f61e-fdce-4f21-87ac-87109cd9bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Flow 'volume_create_manager' (f52e84e3-a718-4386-b3f6-1edbad9ab105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1a968ad3-b8c5-4347-a4dc-a4461546a599 tempest-VolumesGetTest-1222530041 None] Created volume successfully. Jul 03 12:49:38 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b" returned: 0 in 1.134s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:38 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b Jul 03 12:49:38 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-27882c98-bfea-4348-8e1c-45b3e68d4dd2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Lock "cinder-27882c98-bfea-4348-8e1c-45b3e68d4dd2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-27882c98-bfea-4348-8e1c-45b3e68d4dd2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-27882c98-bfea-4348-8e1c-45b3e68d4dd2" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62fa670-280d-4503-aea4-6fca31375cad]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:39 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 Jul 03 12:49:39 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:39 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 1073741824" returned: 0 in 1.299s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:39 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c9cc4e2b-08af-43c7-96f7-8abf958d892b" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:39 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 Jul 03 12:49:39 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-quobyte-c9cc4e2b-08af-43c7-96f7-8abf958d892b" released by "delete_volume" :: held 2.027s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Created reservations ['d9496c5f-867b-4567-9862-0a5fff57b882', '3bb7d8c2-c678-41c8-9a15-6d1cf77bdace', 'bb447ed1-b613-46ac-b8d5-8adaacceb71c', 'b8b93579-28d7-4049-a86f-4d5c48ca06ce'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:39 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:39 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:40 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2" returned: 0 in 0.957s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:40 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2 Jul 03 12:49:40 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:40 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604f72f2-4119-4b50-ab06-5822fef497b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b1316f-7d0b-4e92-b5e2-729cb6458540', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2767cd14-d19a-4a27-aed8-b41f17646d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Volume volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 (65b1316f-7d0b-4e92-b5e2-729cb6458540): created successfully Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2767cd14-d19a-4a27-aed8-b41f17646d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Flow 'volume_create_manager' (850a3df7-4de7-4db8-8bec-987f42618c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-22e11837-9fcf-45fc-9efd-11bcb6d1009e tempest-VolumeQuotasAdminTestJSON-982692494 None] Created volume successfully. Jul 03 12:49:40 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Deleted volume successfully. Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e38b5ad-27f6-4e19-93e8-759947633c5e tempest-AttachVolumeNegativeTest-29985512 None] Lock "cinder-c9cc4e2b-08af-43c7-96f7-8abf958d892b-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "cinder-65b1316f-7d0b-4e92-b5e2-729cb6458540-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "cinder-65b1316f-7d0b-4e92-b5e2-729cb6458540-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "cinder-quobyte-65b1316f-7d0b-4e92-b5e2-729cb6458540" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "cinder-quobyte-65b1316f-7d0b-4e92-b5e2-729cb6458540" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7714591-2e89-44c2-a85c-862d11d7678e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:41 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-27882c98-bfea-4348-8e1c-45b3e68d4dd2" returned: 0 in 0.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-27882c98-bfea-4348-8e1c-45b3e68d4dd2" released by "delete_volume" :: held 1.874s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Created reservations ['f125341a-4297-4df6-863f-3fb9d2c43b88', 'bfc3b976-8794-4a5e-ad26-f1d9a4e19ce7', '5de8a2dd-660f-480f-9975-ac05f6e3e12f', 'a4004c70-29ab-446c-8342-2e20a7d2a32c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:41 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 Jul 03 12:49:41 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:41 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:41 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-057675fe-03bd-40aa-b959-a5da09f3d4b6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Lock "cinder-057675fe-03bd-40aa-b959-a5da09f3d4b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Acquiring lock "cinder-quobyte-057675fe-03bd-40aa-b959-a5da09f3d4b6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-057675fe-03bd-40aa-b959-a5da09f3d4b6" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d87756d-0e7c-44b6-b7b8-681bcc2138d2]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:41 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:41 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:42 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-20795c46-6ea3-4f7f-9dbb-4b80c95f87f6 tempest-VolumesGetTest-1222530041 None] Lock "cinder-27882c98-bfea-4348-8e1c-45b3e68d4dd2-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:42 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540" returned: 0 in 1.212s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:42 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540 Jul 03 12:49:42 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:42 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 0 in 1.157s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:42 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:42 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:43 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-65b1316f-7d0b-4e92-b5e2-729cb6458540" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "cinder-quobyte-65b1316f-7d0b-4e92-b5e2-729cb6458540" released by "delete_volume" :: held 2.170s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Created reservations ['e29619b8-74a1-48e6-9b75-f660f9b7daa6', 'bd66a04a-0f6e-4779-84e5-21c99c766338', '7a3cdbc6-7ff5-4c15-8f8a-345bb36aa9ea', 'df702c3e-8f20-4238-aec9-910f3f04a481'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:43 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:43 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:43 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 1 in 1.142s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:43 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6 Jul 03 12:49:43 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:44 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.955s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Deleted volume successfully. Jul 03 12:49:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1ff79d-4ce1-4601-b902-ec3b3a5d473b tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "cinder-65b1316f-7d0b-4e92-b5e2-729cb6458540-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:45 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-057675fe-03bd-40aa-b959-a5da09f3d4b6" returned: 0 in 1.078s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Lock "cinder-quobyte-057675fe-03bd-40aa-b959-a5da09f3d4b6" released by "delete_volume" :: held 3.473s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Flow 'volume_create_manager' (845c76fd-94c2-4330-96a2-272b9ba95ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc746c44-4e69-4a3a-ae3a-87552d9d58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc746c44-4e69-4a3a-ae3a-87552d9d58ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-290198452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd15ddd-bc68-4963-8c36-cf5f6190ba6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c791777f0b124904b6da9697c5d2d72f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:45Z,use_quota=True,user_id='9a2d30d6ae1a43a5bc614ab1dc627f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914129bc-a5db-4a24-918b-ac409f81b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914129bc-a5db-4a24-918b-ac409f81b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ec79ad-19fc-4282-82bb-37341cefcdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ec79ad-19fc-4282-82bb-37341cefcdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd15ddd-bc68-4963-8c36-cf5f6190ba6c', 'volume_name': 'volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62337a6f-2ae5-44dd-8fb4-e22beac17697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62337a6f-2ae5-44dd-8fb4-e22beac17697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da501bfe-4964-4303-a293-566856c5bbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Volume dfd15ddd-bc68-4963-8c36-cf5f6190ba6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c', 'volume_size': 1} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-290198452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd15ddd-bc68-4963-8c36-cf5f6190ba6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c791777f0b124904b6da9697c5d2d72f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:45Z,use_quota=True,user_id='9a2d30d6ae1a43a5bc614ab1dc627f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Creating volume dfd15ddd-bc68-4963-8c36-cf5f6190ba6c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:45 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Created reservations ['ae076f20-5c3b-4495-9b13-4107ed086855', '031a59eb-3235-4630-ae04-81dee2a90f67', '715b38f3-9dd5-47b0-aab5-e421f380effb', 'ddb57606-b24d-4b74-9732-8570f20efdf2'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:45 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c 1073741824 Jul 03 12:49:45 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:45 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:45 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:46 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.047s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Deleted volume successfully. Jul 03 12:49:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9bea92a-fc98-43a6-9bbc-7cb425375e65 tempest-VolumesGetTest-1222530041 None] Lock "cinder-057675fe-03bd-40aa-b959-a5da09f3d4b6-delete_volume" released by "delete_volume" :: held 4.985s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:46 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c 1073741824" returned: 0 in 1.456s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:46 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c Jul 03 12:49:46 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:47 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c" returned: 0 in 1.182s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] <== create_volume: return (2689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da501bfe-4964-4303-a293-566856c5bbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de37e9d-de86-41af-b515-59d828a488dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Volume volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c (dfd15ddd-bc68-4963-8c36-cf5f6190ba6c): created successfully Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de37e9d-de86-41af-b515-59d828a488dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Flow 'volume_create_manager' (845c76fd-94c2-4330-96a2-272b9ba95ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-561a3b0c-a520-4234-b98b-fa0fce1fc3b4 tempest-VolumeQuotasAdminTestJSON-982692494 None] Created volume successfully. Jul 03 12:49:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-94c913b9-b8d1-4a64-9e5f-bc45edf57353 tempest-VolumeQuotasAdminTestJSON-842089087 None] Transfer volume completed successfully. Jul 03 12:49:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Acquiring lock "cinder-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Lock "cinder-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Acquiring lock "cinder-quobyte-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Lock "cinder-quobyte-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[21689540-b725-4d6b-86e1-8d7ec6e0658a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:51 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c Jul 03 12:49:51 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:52 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c" returned: 0 in 1.235s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:52 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c Jul 03 12:49:52 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:53 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c" returned: 0 in 1.091s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Lock "cinder-quobyte-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c" released by "delete_volume" :: held 2.419s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Created reservations ['b0ca2cb1-377f-423b-9750-f987f8a6ec7e', 'a909de56-2ab2-442b-a33e-753589e1a9c4', 'f50a7f46-7c14-4765-be35-ebd05503f3b9', '0f118dab-ad73-480e-887c-0d9f57f32b96'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Flow 'volume_create_manager' (e94d6831-4173-434f-8f44-0343d0ec00cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfc174e-c697-41b6-a892-18ad11e0a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfc174e-c697-41b6-a892-18ad11e0a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2003576875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8369f3-72fb-46ea-9707-3e7aaf112211,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4afa31a0e1349e19dc64c4e2ff4ef56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:53Z,use_quota=True,user_id='49bdc80548944d02ae3f6e6b19a6ea9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6380e8-35cd-47ce-b8d8-7221b2ada547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6380e8-35cd-47ce-b8d8-7221b2ada547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60a339d-7b4e-4bcc-8955-f05c93febde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60a339d-7b4e-4bcc-8955-f05c93febde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8369f3-72fb-46ea-9707-3e7aaf112211', 'volume_name': 'volume-ae8369f3-72fb-46ea-9707-3e7aaf112211', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686a67be-6e86-4fc7-af31-d6397614a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686a67be-6e86-4fc7-af31-d6397614a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc615803-19ed-4046-8708-d096d2aae867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Volume ae8369f3-72fb-46ea-9707-3e7aaf112211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8369f3-72fb-46ea-9707-3e7aaf112211', 'volume_size': 1} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2003576875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8369f3-72fb-46ea-9707-3e7aaf112211,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4afa31a0e1349e19dc64c4e2ff4ef56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:53Z,use_quota=True,user_id='49bdc80548944d02ae3f6e6b19a6ea9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Creating volume ae8369f3-72fb-46ea-9707-3e7aaf112211 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:49:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:53 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 1073741824 Jul 03 12:49:53 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:53 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:53 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:54 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:54 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:49:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Deleted volume successfully. Jul 03 12:49:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-596c4b41-9172-4508-8c37-02b512a2acc5 tempest-VolumeQuotasAdminTestJSON-870648990 None] Lock "cinder-dfd15ddd-bc68-4963-8c36-cf5f6190ba6c-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:55 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 1073741824" returned: 0 in 1.527s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:55 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 Jul 03 12:49:55 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:56 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211" returned: 0 in 1.016s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] <== create_volume: return (2616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.621s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc615803-19ed-4046-8708-d096d2aae867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8369f3-72fb-46ea-9707-3e7aaf112211', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ee2e19-fa85-41ff-91d7-09a51510a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:49:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Volume volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 (ae8369f3-72fb-46ea-9707-3e7aaf112211): created successfully Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ee2e19-fa85-41ff-91d7-09a51510a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:49:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Flow 'volume_create_manager' (e94d6831-4173-434f-8f44-0343d0ec00cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:49:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4cdc25c4-a68a-4148-8051-5a10657fec78 req-e577fc58-d408-427b-af25-1769098e3013 tempest-VolumesGetTestJSON-1822842097 None] Created volume successfully. Jul 03 12:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Acquiring lock "cinder-ae8369f3-72fb-46ea-9707-3e7aaf112211-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Lock "cinder-ae8369f3-72fb-46ea-9707-3e7aaf112211-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Acquiring lock "cinder-quobyte-ae8369f3-72fb-46ea-9707-3e7aaf112211" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Lock "cinder-quobyte-ae8369f3-72fb-46ea-9707-3e7aaf112211" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:49:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[071841b1-3590-4996-9fd4-0bf55aa48d8a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:49:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:57 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 Jul 03 12:49:57 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:58 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211" returned: 0 in 1.124s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:58 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211 Jul 03 12:49:58 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:49:59 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ae8369f3-72fb-46ea-9707-3e7aaf112211" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Lock "cinder-quobyte-ae8369f3-72fb-46ea-9707-3e7aaf112211" released by "delete_volume" :: held 2.110s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG cinder.quota [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Created reservations ['56940f07-a97a-4c4b-8e71-3e67efea00f7', 'dde70ae6-b5a8-4f81-b904-b6075bf320e3', 'e6cf17ce-6fa1-4701-93a1-7d1b098317f8', 'a97409e5-4f4c-4fe6-8544-d569badeed54'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:49:59 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:49:59 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:00 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.752s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:00 devstack cinder-volume[86966]: DEBUG cinder.manager [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:50:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Deleted volume successfully. Jul 03 12:50:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-55c98abe-84d6-45a9-8ba5-08b7961fd264 req-f4da2347-6daa-41d5-9dfe-8bf22e5178bd tempest-VolumesGetTestJSON-1822842097 None] Lock "cinder-ae8369f3-72fb-46ea-9707-3e7aaf112211-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:01 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:50:01 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:02 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=128,cinder:UPDATE=178,cinder:DELETE=13,cinder:INSERT=43 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (0a6d06da-631b-47fa-858b-a6e2ffc6806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d7fa46-4ec9-46c1-9b6e-83e9afc61581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d7fa46-4ec9-46c1-9b6e-83e9afc61581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2041001132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f85748-d612-4a1d-ada2-11496d08b1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:05Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9598c7e2-82bd-493f-80f8-b04f3b120d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9598c7e2-82bd-493f-80f8-b04f3b120d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a95dcf-1f5c-490f-a60f-351eae7bf633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a95dcf-1f5c-490f-a60f-351eae7bf633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f85748-d612-4a1d-ada2-11496d08b1f7', 'volume_name': 'volume-c0f85748-d612-4a1d-ada2-11496d08b1f7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff54161-d1af-410f-8bcb-b09bd928a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff54161-d1af-410f-8bcb-b09bd928a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e77740-7437-4e82-b5fa-0a79eb014dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Volume c0f85748-d612-4a1d-ada2-11496d08b1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f85748-d612-4a1d-ada2-11496d08b1f7', 'volume_size': 1} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2041001132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f85748-d612-4a1d-ada2-11496d08b1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:05Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Creating volume c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:50:05 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:05 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 1073741824 Jul 03 12:50:05 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:06 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 1073741824" returned: 0 in 1.341s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:06 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 Jul 03 12:50:06 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:07 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7" returned: 0 in 0.932s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e77740-7437-4e82-b5fa-0a79eb014dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f85748-d612-4a1d-ada2-11496d08b1f7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670db2ef-378f-4690-bf92-721cc397ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Volume volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 (c0f85748-d612-4a1d-ada2-11496d08b1f7): created successfully Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670db2ef-378f-4690-bf92-721cc397ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (0a6d06da-631b-47fa-858b-a6e2ffc6806d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e6559867-31c3-4cfc-9a37-ddd900b047ee tempest-VolumesSnapshotTestJSON-1059001696 None] Created volume successfully. Jul 03 12:50:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating offline snapshot 7658461b-68b0-405a-9e0e-416c57c321e7 of volume c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:50:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0772a740-5234-46a5-aaa0-437d6ff839bd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:09 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 Jul 03 12:50:09 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:10 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7" returned: 0 in 1.450s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:10 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 1G Jul 03 12:50:10 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:12 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 1G" returned: 0 in 1.419s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:12 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 Jul 03 12:50:12 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:13 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7" returned: 0 in 1.077s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 is being set with open permissions: ugo+rw Jul 03 12:50:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:13 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 Jul 03 12:50:13 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:14 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7" returned: 0 in 1.169s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:14 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info Jul 03 12:50:14 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Flow 'volume_create_manager' (c97ee160-6b7b-4632-912a-c3345dd22b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d86c011-c0a9-43fd-85a2-5ff681ee11f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d86c011-c0a9-43fd-85a2-5ff681ee11f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-905951108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5552ad10-be6f-4819-b62d-d2813a489341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a676baa8fe414ae49b20cbd41f4d1e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:14Z,use_quota=True,user_id='e3ce1fc4175b4035a22ea7b1a3cebbf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb58a5fb-7a62-4b3f-a65d-84f9d501f1e0),volume_type_id=eb58a5fb-7a62-4b3f-a65d-84f9d501f1e0)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef06e0c-4a03-4d35-981a-b496505853c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef06e0c-4a03-4d35-981a-b496505853c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54aec7b2-5ee5-432c-9873-5d247a719fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54aec7b2-5ee5-432c-9873-5d247a719fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5552ad10-be6f-4819-b62d-d2813a489341', 'volume_name': 'volume-5552ad10-be6f-4819-b62d-d2813a489341', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcdb7d2-afb3-4f5c-953a-0f3a989342ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcdb7d2-afb3-4f5c-953a-0f3a989342ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0506fc1-0e08-4968-8ca6-7dde6cca4db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Volume 5552ad10-be6f-4819-b62d-d2813a489341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5552ad10-be6f-4819-b62d-d2813a489341', 'volume_size': 1} Jul 03 12:50:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:15 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:15 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info is being set with open permissions: ugo+rw Jul 03 12:50:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:15 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info Jul 03 12:50:15 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:16 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.info" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.156s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-905951108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5552ad10-be6f-4819-b62d-d2813a489341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a676baa8fe414ae49b20cbd41f4d1e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:14Z,use_quota=True,user_id='e3ce1fc4175b4035a22ea7b1a3cebbf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb58a5fb-7a62-4b3f-a65d-84f9d501f1e0),volume_type_id=eb58a5fb-7a62-4b3f-a65d-84f9d501f1e0)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Creating volume 5552ad10-be6f-4819-b62d-d2813a489341 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:50:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:16 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 1073741824 Jul 03 12:50:16 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f42c84ab-f630-40dd-bb46-e4e089016b95 tempest-VolumesSnapshotTestJSON-1059001696 None] Create snapshot completed successfully Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-7658461b-68b0-405a-9e0e-416c57c321e7-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-7658461b-68b0-405a-9e0e-416c57c321e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-c0f85748-d612-4a1d-ada2-11496d08b1f7" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-c0f85748-d612-4a1d-ada2-11496d08b1f7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-7658461b-68b0-405a-9e0e-416c57c321e7" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-7658461b-68b0-405a-9e0e-416c57c321e7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Deleting offline snapshot 7658461b-68b0-405a-9e0e-416c57c321e7 of volume c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] snapshot_file for this snap is: volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74863f9-8585-4a97-b1b7-ed28ad62f00d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:17 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 Jul 03 12:50:17 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e132995e-974b-4e2d-8ca1-4268851889bb tempest-BackendsCapabilitiesAdminTestsJSON-1292834894 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7511024475098, 'free_capacity_gb': 1775.7511024475098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 12:50:17 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 1073741824" returned: 0 in 1.203s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:17 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 Jul 03 12:50:17 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c4b4d6b-4933-4ed9-8941-2e096602bbf2 tempest-BackendsCapabilitiesAdminTestsJSON-1292834894 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7511024475098, 'free_capacity_gb': 1775.7511024475098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 12:50:18 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7" returned: 0 in 1.086s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0f85748-d612-4a1d-ada2-11496d08b1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a45bcfc-98b9-4333-af4c-d86bce41af44]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:18 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 Jul 03 12:50:18 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:18 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341" returned: 0 in 0.897s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0506fc1-0e08-4968-8ca6-7dde6cca4db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5552ad10-be6f-4819-b62d-d2813a489341', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4911ba-7541-4cd7-859f-c06b4f0d3fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Volume volume-5552ad10-be6f-4819-b62d-d2813a489341 (5552ad10-be6f-4819-b62d-d2813a489341): created successfully Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4911ba-7541-4cd7-859f-c06b4f0d3fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Flow 'volume_create_manager' (c97ee160-6b7b-4632-912a-c3345dd22b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e5955408-0f5f-4540-ba9a-3186e14f9a57 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Created volume successfully. Jul 03 12:50:19 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7" returned: 0 in 1.133s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:19 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 Jul 03 12:50:19 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:19 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:50:19 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:20 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:20 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.938s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:50:20 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7 Jul 03 12:50:20 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f5ad8120-3053-48fb-888e-5e6432fd7db7 tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Retype volume completed successfully. Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Acquiring lock "cinder-5552ad10-be6f-4819-b62d-d2813a489341-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "cinder-5552ad10-be6f-4819-b62d-d2813a489341-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Acquiring lock "cinder-quobyte-5552ad10-be6f-4819-b62d-d2813a489341" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "cinder-quobyte-5552ad10-be6f-4819-b62d-d2813a489341" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049c41b-fafc-41dd-b846-fc7e4e26c3cf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:21 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 Jul 03 12:50:21 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:21 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7.7658461b-68b0-405a-9e0e-416c57c321e7" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-7658461b-68b0-405a-9e0e-416c57c321e7" released by "_delete_snapshot" :: held 4.353s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-c0f85748-d612-4a1d-ada2-11496d08b1f7" released by "delete_snapshot" :: held 4.387s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['845518af-49d3-4ffd-ad77-001f330d4310', '6a581944-b2af-4968-a776-84e14946fcd4', '53de2ebb-0389-4939-9e83-06619bca65df', 'a7c02806-ca4d-4a95-8800-67366fd8b4bd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:50:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Delete snapshot completed successfully. Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-55c10bf1-7108-43d0-96a8-c456e297f6f1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-7658461b-68b0-405a-9e0e-416c57c321e7-delete_snapshot" released by "delete_snapshot" :: held 4.699s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:21 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:21 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341 Jul 03 12:50:21 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:22 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-5552ad10-be6f-4819-b62d-d2813a489341" returned: 0 in 1.084s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "cinder-quobyte-5552ad10-be6f-4819-b62d-d2813a489341" released by "delete_volume" :: held 2.134s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (a2e029df-591a-45cc-968b-15a2b8e9d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b14d23-3a6d-4ef0-b737-f710eee40919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:23 devstack cinder-volume[86966]: WARNING cinder.quota [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:50:23 devstack cinder-volume[86966]: WARNING cinder.quota [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b14d23-3a6d-4ef0-b737-f710eee40919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76176250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d557707-9145-4a42-8fe9-d038c41c85dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:23Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbb4a4f-8088-45ca-b885-949bbaa82183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbb4a4f-8088-45ca-b885-949bbaa82183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daf3ae2-192f-4b3f-8d76-6afa38cb08ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daf3ae2-192f-4b3f-8d76-6afa38cb08ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d557707-9145-4a42-8fe9-d038c41c85dc', 'volume_name': 'volume-4d557707-9145-4a42-8fe9-d038c41c85dc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c085bbb0-2b25-4981-8395-efcd2b292f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c085bbb0-2b25-4981-8395-efcd2b292f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5032a294-8d8b-4f00-9bb7-95f95b4856c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:23 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume 4d557707-9145-4a42-8fe9-d038c41c85dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d557707-9145-4a42-8fe9-d038c41c85dc', 'volume_size': 1} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76176250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d557707-9145-4a42-8fe9-d038c41c85dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:23Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating volume 4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:50:23 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:23 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc 1073741824 Jul 03 12:50:23 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Created reservations ['75d7b757-1494-49ca-bde5-c1200abba861', '61d9d834-1c43-4dd8-8187-c9ebf9538823', 'dd6327e3-b60e-4d9f-867f-11b88f65da91', 'fa836e27-0d09-41bb-81f4-4ac917e8a270'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:23 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:50:23 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:24 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.923s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:24 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:50:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Deleted volume successfully. Jul 03 12:50:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339c8a7f-ad09-471f-af98-b5ec8f8666ed tempest-VolumeRetypeWithoutMigrationTest-1790507356 None] Lock "cinder-5552ad10-be6f-4819-b62d-d2813a489341-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:24 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc 1073741824" returned: 0 in 1.277s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:24 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:24 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:25 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 1.175s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5032a294-8d8b-4f00-9bb7-95f95b4856c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d557707-9145-4a42-8fe9-d038c41c85dc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba412f5-2b13-4309-83fc-8d99aa7ad913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume volume-4d557707-9145-4a42-8fe9-d038c41c85dc (4d557707-9145-4a42-8fe9-d038c41c85dc): created successfully Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba412f5-2b13-4309-83fc-8d99aa7ad913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (a2e029df-591a-45cc-968b-15a2b8e9d571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bed23383-0058-4de5-addc-3665de6c8406 tempest-VolumesSnapshotTestJSON-1059001696 None] Created volume successfully. Jul 03 12:50:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating offline snapshot 5810a91f-eb37-432f-bd5b-5f76c0189b00 of volume 4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:50:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee364f1-23ec-4708-9092-a9755c043f6e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:26 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:26 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7ab2e722-142e-4a48-be45-e79045152243 tempest-GroupSnapshotsV319Test-415226885 None] Group tempest-GroupSnapshotsV319Test-Group-562732020: creating Jul 03 12:50:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7ab2e722-142e-4a48-be45-e79045152243 tempest-GroupSnapshotsV319Test-415226885 None] Group tempest-GroupSnapshotsV319Test-Group-562732020: created successfully Jul 03 12:50:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7ab2e722-142e-4a48-be45-e79045152243 tempest-GroupSnapshotsV319Test-415226885 None] Create group completed successfully. Jul 03 12:50:27 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 1.220s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:27 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 1G Jul 03 12:50:27 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Flow 'volume_create_manager' (8b20e31c-3b53-4dc7-8274-51bd1828571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756c9e0a-d1f4-44f1-bae3-5a64a226b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756c9e0a-d1f4-44f1-bae3-5a64a226b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814302026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36241225-a4db-484c-9059-7d450cc33055,host='devstack@QuobyteHD#QuobyteHD',id=18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34248ceedde242019b959281443626d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:29Z,use_quota=True,user_id='b86f353507cd409cb3c88623be955115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3eb9d023-81f7-4877-bbe5-22efefafbaa5),volume_type_id=3eb9d023-81f7-4877-bbe5-22efefafbaa5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac8b50-039e-47fa-b43c-3c9a7ae8a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac8b50-039e-47fa-b43c-3c9a7ae8a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7995428-f18e-462c-b806-cbd02bd6162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7995428-f18e-462c-b806-cbd02bd6162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc', 'volume_name': 'volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5493ad32-fd59-40f8-8938-cce60b09d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5493ad32-fd59-40f8-8938-cce60b09d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea4f9ba-a65a-4931-be35-ef8d4242c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Volume 18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc', 'volume_size': 1} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:29 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 1G" returned: 0 in 1.508s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d557707-9145-4a42-8fe9-d038c41c85dc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:29 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d557707-9145-4a42-8fe9-d038c41c85dc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 Jul 03 12:50:29 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:30 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d557707-9145-4a42-8fe9-d038c41c85dc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:30 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 is being set with open permissions: ugo+rw Jul 03 12:50:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:30 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 Jul 03 12:50:30 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:31 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:31 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info Jul 03 12:50:31 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:31 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info" returned: 0 in 0.814s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:31 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info is being set with open permissions: ugo+rw Jul 03 12:50:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:32 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info Jul 03 12:50:32 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:32 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.info" returned: 0 in 0.800s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.245s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.561s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36241225-a4db-484c-9059-7d450cc33055,created_at=2026-07-03T10:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814302026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36241225-a4db-484c-9059-7d450cc33055,host='devstack@QuobyteHD#QuobyteHD',id=18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34248ceedde242019b959281443626d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:29Z,use_quota=True,user_id='b86f353507cd409cb3c88623be955115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3eb9d023-81f7-4877-bbe5-22efefafbaa5),volume_type_id=3eb9d023-81f7-4877-bbe5-22efefafbaa5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Creating volume 18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:50:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:32 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=92,cinder:INSERT=33,cinder:UPDATE=115,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:50:32 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc 1073741824 Jul 03 12:50:32 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5b454f9a-6e10-4a28-85de-dc0665de0024 tempest-VolumesSnapshotTestJSON-1059001696 None] Create snapshot completed successfully Jul 03 12:50:34 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc 1073741824" returned: 0 in 1.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:34 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc Jul 03 12:50:34 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (92fb131b-c2ec-4084-a93d-580e5bfeed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33654bf-a035-4283-a6ed-64f1294cc2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33654bf-a035-4283-a6ed-64f1294cc2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1360776573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d376d5-0e2b-4141-838f-46cf351205bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5810a91f-eb37-432f-bd5b-5f76c0189b00,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:35Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e34a560-0ed3-4326-a307-d69821b35684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e34a560-0ed3-4326-a307-d69821b35684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d128113d-de4e-4d01-9d9f-60d9676f8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d128113d-de4e-4d01-9d9f-60d9676f8908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38d376d5-0e2b-4141-838f-46cf351205bd', 'volume_name': 'volume-38d376d5-0e2b-4141-838f-46cf351205bd', 'volume_size': 2, 'snapshot_id': '5810a91f-eb37-432f-bd5b-5f76c0189b00'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c19421-f930-418b-8fbf-b71df962663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c19421-f930-418b-8fbf-b71df962663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70496e34-2235-490c-950e-52a672addbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume 38d376d5-0e2b-4141-838f-46cf351205bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38d376d5-0e2b-4141-838f-46cf351205bd', 'volume_size': 2, 'snapshot_id': '5810a91f-eb37-432f-bd5b-5f76c0189b00'} Jul 03 12:50:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:36 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" returned: 0 in 1.460s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] <== create_volume: return (3305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.309s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.741s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-5810a91f-eb37-432f-bd5b-5f76c0189b00-38d376d5-0e2b-4141-838f-46cf351205bd" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea4f9ba-a65a-4931-be35-ef8d4242c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f39db0-4f30-4fa5-aa46-55e30248edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-5810a91f-eb37-432f-bd5b-5f76c0189b00-38d376d5-0e2b-4141-838f-46cf351205bd" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating volume 38d376d5-0e2b-4141-838f-46cf351205bd from snapshot 5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-38d376d5-0e2b-4141-838f-46cf351205bd" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Volume volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc (18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc): created successfully Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f39db0-4f30-4fa5-aa46-55e30248edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Flow 'volume_create_manager' (8b20e31c-3b53-4dc7-8274-51bd1828571f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-38d376d5-0e2b-4141-838f-46cf351205bd" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] snapshot: 5810a91f-eb37-432f-bd5b-5f76c0189b00, volume: 38d376d5-0e2b-4141-838f-46cf351205bd, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8bb65c2a-f404-4a58-9c9f-b302f7eed93d tempest-GroupSnapshotsV319Test-415226885 None] Created volume successfully. Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a67f97-640f-4991-9bcd-53fec0377219]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:36 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 Jul 03 12:50:36 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] GroupSnapshot 235725e3-65b3-4144-bb80-65c5a7a95c8f: creating. Jul 03 12:50:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Group snapshot 235725e3-65b3-4144-bb80-65c5a7a95c8f: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:38 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00" returned: 0 in 1.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d557707-9145-4a42-8fe9-d038c41c85dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4102c2f-161a-4730-88ae-b34904e1d2b4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:38 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:38 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:39 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 1.268s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:39 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:50:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:39 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd Jul 03 12:50:39 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd" returned: 0 in 7.527s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035c620-5da2-49b1-b09e-921d30385cf4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:47 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:47 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:47 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=49,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:50:48 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 1.259s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:50:48 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Converted 1024.00 MB image at 135.93 MB/s Jul 03 12:50:48 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd is being set with open permissions: ugo+rw Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:48 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd Jul 03 12:50:48 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Flow 'volume_create_manager' (737f03a9-7c0a-4d0c-9cf0-a2b967bdeea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228e74b4-2d56-4a6a-ab37-84004bec4960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228e74b4-2d56-4a6a-ab37-84004bec4960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1660650583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a085541-3f56-44d5-ab87-3b6094424bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c720ae6f12e42718c907aca455e2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:48Z,use_quota=True,user_id='a27bf90f27d74ee79fad293172a8c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4cde36-61ac-478e-a8df-2a62228bc9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4cde36-61ac-478e-a8df-2a62228bc9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460135d7-a548-40e3-a105-e4205265e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460135d7-a548-40e3-a105-e4205265e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a085541-3f56-44d5-ab87-3b6094424bcd', 'volume_name': 'volume-2a085541-3f56-44d5-ab87-3b6094424bcd', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331171de-57c0-4839-a520-29fbb13f485b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331171de-57c0-4839-a520-29fbb13f485b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafe1999-aaf8-474c-811f-d4b5c8a40c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Volume 2a085541-3f56-44d5-ab87-3b6094424bcd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a085541-3f56-44d5-ab87-3b6094424bcd', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Trying to clone 2a085541-3f56-44d5-ab87-3b6094424bcd from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 12:50:48 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd" returned: 0 in 0.789s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-38d376d5-0e2b-4141-838f-46cf351205bd" released by "_copy_volume_from_snapshot" :: held 12.667s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-5810a91f-eb37-432f-bd5b-5f76c0189b00-38d376d5-0e2b-4141-838f-46cf351205bd" released by "_create_volume_from_snapshot" :: held 12.736s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.788s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Creating offline snapshot 087279b4-644d-4abc-a037-ba55e613e994 of volume 18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70496e34-2235-490c-950e-52a672addbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d376d5-0e2b-4141-838f-46cf351205bd', 'volume_size': 2, 'snapshot_id': '5810a91f-eb37-432f-bd5b-5f76c0189b00'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9749125-db61-4b48-8564-cd1f620c52b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc7bf63-affd-4f38-9aa6-adc59f05c579]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume volume-38d376d5-0e2b-4141-838f-46cf351205bd (38d376d5-0e2b-4141-838f-46cf351205bd): created successfully Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9749125-db61-4b48-8564-cd1f620c52b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (92fb131b-c2ec-4084-a93d-580e5bfeed95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:50:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-702fb7ac-dd6d-45cb-b09a-9676b2805c83 tempest-VolumesSnapshotTestJSON-1059001696 None] Created volume successfully. Jul 03 12:50:49 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc Jul 03 12:50:49 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 12:50:49 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Image download 20.69 MB at 20.69 MB/s Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf9229-22dd-40e1-b2e2-c6ece06ae0b1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:49 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD Jul 03 12:50:49 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:49 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:49 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 1G Jul 03 12:50:49 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:50 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b is fetched for user a27bf90f27d74ee79fad293172a8c9e0. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3ac45-fb1a-41fd-8188-b726212e4a35]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:50 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD Jul 03 12:50:50 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-38d376d5-0e2b-4141-838f-46cf351205bd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-38d376d5-0e2b-4141-838f-46cf351205bd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-38d376d5-0e2b-4141-838f-46cf351205bd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-38d376d5-0e2b-4141-838f-46cf351205bd" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314f173-11fa-4674-8ef0-a79e00857a33]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:50 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd Jul 03 12:50:50 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:50 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 1G" returned: 0 in 0.925s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:50 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 Jul 03 12:50:50 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:51 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:51 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:51 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd Jul 03 12:50:51 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:51 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:51 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:51 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 Jul 03 12:50:51 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:52 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-38d376d5-0e2b-4141-838f-46cf351205bd" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-38d376d5-0e2b-4141-838f-46cf351205bd" released by "delete_volume" :: held 1.788s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['35715b6b-f067-4432-bd76-c89663bd355b', '13d55ca7-38e3-4400-b710-4215ec61eab9', 'e9331443-0976-4d89-b638-01c0a870905d', '8a64a076-d0b0-4d44-9e81-5e2fe9cee284'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:50:52 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:52 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:50:52 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:52 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info Jul 03 12:50:52 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-5810a91f-eb37-432f-bd5b-5f76c0189b00-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-5810a91f-eb37-432f-bd5b-5f76c0189b00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-4d557707-9145-4a42-8fe9-d038c41c85dc" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-4d557707-9145-4a42-8fe9-d038c41c85dc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-5810a91f-eb37-432f-bd5b-5f76c0189b00" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-5810a91f-eb37-432f-bd5b-5f76c0189b00" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Deleting offline snapshot 5810a91f-eb37-432f-bd5b-5f76c0189b00 of volume 4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] snapshot_file for this snap is: volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a01cc-f2a8-444d-931c-7cd3ac1664f0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:52 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 Jul 03 12:50:52 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:53 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:50:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Deleted volume successfully. Jul 03 12:50:53 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info" returned: 0 in 0.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:53 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:53 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info Jul 03 12:50:53 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-175543e1-701d-4855-b6de-8c313940c065 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-38d376d5-0e2b-4141-838f-46cf351205bd-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:53 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00" returned: 0 in 0.977s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d557707-9145-4a42-8fe9-d038c41c85dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb37c634-4af5-443d-ab8a-efa601d49a9d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:54 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:54 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:54 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.info" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.134s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.980s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1660650583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a085541-3f56-44d5-ab87-3b6094424bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c720ae6f12e42718c907aca455e2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:48Z,use_quota=True,user_id='a27bf90f27d74ee79fad293172a8c9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Creating volume 2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:50:54 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:54 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd 1073741824 Jul 03 12:50:54 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ea111d71-970c-42f7-bd4b-ee3771af32a0 tempest-GroupSnapshotsV319Test-415226885 None] group_snapshot 235725e3-65b3-4144-bb80-65c5a7a95c8f: created successfully Jul 03 12:50:54 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 1.121s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:55 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 Jul 03 12:50:55 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] group_snapshot 235725e3-65b3-4144-bb80-65c5a7a95c8f: deleting Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] group_snapshot 235725e3-65b3-4144-bb80-65c5a7a95c8f: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "cinder-quobyte-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Lock "cinder-quobyte-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "cinder-quobyte-087279b4-644d-4abc-a037-ba55e613e994" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Lock "cinder-quobyte-087279b4-644d-4abc-a037-ba55e613e994" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Deleting offline snapshot 087279b4-644d-4abc-a037-ba55e613e994 of volume 18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] snapshot_file for this snap is: volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ccf70-b0ab-4ed4-aca8-13a7e488c8ac]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:55 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 Jul 03 12:50:55 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:55 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd 1073741824" returned: 0 in 1.363s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:55 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:50:55 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:56 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00" returned: 0 in 1.119s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:56 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00 Jul 03 12:50:56 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:56 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994" returned: 0 in 1.011s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd89f3c-b290-4233-9969-0988585398c9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:56 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 0 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Attempting download of 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume 2a085541-3f56-44d5-ab87-3b6094424bcd. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[911ab36e-76d7-4ad2-9b5f-8ff23ac1d6b1]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:56 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc Jul 03 12:50:56 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:56 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g Jul 03 12:50:56 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:56 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc.5810a91f-eb37-432f-bd5b-5f76c0189b00" returned: 0 in 0.821s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-5810a91f-eb37-432f-bd5b-5f76c0189b00" released by "_delete_snapshot" :: held 4.196s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-4d557707-9145-4a42-8fe9-d038c41c85dc" released by "delete_snapshot" :: held 4.223s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:57 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['fc21a206-ec20-4b0d-8543-be7830ec3561', '8e596678-4153-42d1-b710-601be0f2587b', '57824752-6aa6-4748-a42a-addcb4cab389', 'a0cbd67d-4b1d-4d4f-9eb9-7b5179f3c539'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:50:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Delete snapshot completed successfully. Jul 03 12:50:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0005301-e666-427f-9c88-08d7d6da16b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-5810a91f-eb37-432f-bd5b-5f76c0189b00-delete_snapshot" released by "delete_snapshot" :: held 4.414s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:57 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:57 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 Jul 03 12:50:57 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:57 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:57 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g Jul 03 12:50:57 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:58 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-4d557707-9145-4a42-8fe9-d038c41c85dc-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994" returned: 0 in 0.974s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:58 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994 Jul 03 12:50:58 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-4d557707-9145-4a42-8fe9-d038c41c85dc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:58 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g" returned: 1 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_m5tt_i8g' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3acbdde-2f5d-46ed-9f35-9f63d8e8775a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-4d557707-9145-4a42-8fe9-d038c41c85dc" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-4d557707-9145-4a42-8fe9-d038c41c85dc" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6d2fab-b6de-4a06-a40b-d28c86e56ee7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:58 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD Jul 03 12:50:58 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:58 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:58 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:58 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc.087279b4-644d-4abc-a037-ba55e613e994" returned: 0 in 0.766s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Lock "cinder-quobyte-087279b4-644d-4abc-a037-ba55e613e994" released by "_delete_snapshot" :: held 3.777s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Lock "cinder-quobyte-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" released by "delete_snapshot" :: held 3.820s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:50:59 devstack cinder-volume[86966]: WARNING cinder.quota [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691699160 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691699160, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:50:59 devstack cinder-volume[86966]: WARNING cinder.quota [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691699160 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691699160, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:50:59 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD" returned: 0 in 0.879s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] 8afb0fcf-aee7-4200-b86c-2c05ba162c4b was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] Created reservations ['fdf8f73b-1675-485e-820a-ba473e24ae8d', '29c7558d-00d9-4ac8-80c1-6bb05ca971ac', 'ead91d9c-67d1-4113-b355-87529c9d5d07', '4177396a-860f-4b00-8b2b-38957417093c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:50:59 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:50:59 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:50:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-47d1c0c7-fb12-4d31-96b5-7bef915edaa3 tempest-GroupSnapshotsV319Test-415226885 None] group_snapshot 235725e3-65b3-4144-bb80-65c5a7a95c8f: deleted successfully Jul 03 12:50:59 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:50:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:50:59 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc Jul 03 12:50:59 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "cinder-quobyte-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Lock "cinder-quobyte-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4114b-4cc9-4a7e-8e45-4cf08ffeeb70]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:00 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d557707-9145-4a42-8fe9-d038c41c85dc" returned: 0 in 0.979s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-4d557707-9145-4a42-8fe9-d038c41c85dc" released by "delete_volume" :: held 2.050s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Flow 'volume_create_manager' (f1c716e0-84c4-4984-bfde-648ce593b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af88811a-8c83-4cef-97c6-344c9b9a4ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:00 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc Jul 03 12:51:00 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af88811a-8c83-4cef-97c6-344c9b9a4ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2000264564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565a9d12-ffb9-4369-b817-e0d9098fc0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d1407663c444078ba4e679a0cdd983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:00Z,use_quota=True,user_id='c34433e493f84dcda6dc9c48f0e947ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05984d79-9c5b-4ea6-b849-b38954beae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05984d79-9c5b-4ea6-b849-b38954beae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c7c21d-ae12-474c-bd66-7e5784dfefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c7c21d-ae12-474c-bd66-7e5784dfefda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565a9d12-ffb9-4369-b817-e0d9098fc0f2', 'volume_name': 'volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bacb28f-4541-43d5-bf89-a815c3f1d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bacb28f-4541-43d5-bf89-a815c3f1d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ead6aa-7a3f-47e4-a30f-c93c3fe95987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Volume 565a9d12-ffb9-4369-b817-e0d9098fc0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2', 'volume_size': 1} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2000264564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565a9d12-ffb9-4369-b817-e0d9098fc0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d1407663c444078ba4e679a0cdd983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:00Z,use_quota=True,user_id='c34433e493f84dcda6dc9c48f0e947ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Creating volume 565a9d12-ffb9-4369-b817-e0d9098fc0f2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:00 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:00 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 1073741824 Jul 03 12:51:00 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['5200135f-b7fd-4af4-8cf5-7a6bda9dd54f', 'd1113a6c-5ede-40ca-9dc0-a532415ae391', 'fc6a76f0-45b5-4640-bbb8-d1eec134848f', '44739ace-11b2-44d9-a465-b4af7d258007'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:00 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:00 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:01 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" returned: 0 in 1.090s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:01 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc Jul 03 12:51:01 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:01 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.033s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Deleted volume successfully. Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c587ed45-b402-403b-8a48-3737614cd8b1 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-4d557707-9145-4a42-8fe9-d038c41c85dc-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:01 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 1073741824" returned: 0 in 1.270s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:01 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 Jul 03 12:51:01 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:01 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:01 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:02 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 0 in 2.996s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_6r4zdla_devstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:51:02 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Converted 112.00 MB image at 37.36 MB/s Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:02 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd 1G Jul 03 12:51:02 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:02 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" returned: 0 in 1.057s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Lock "cinder-quobyte-18ab0aa7-dc9b-4c04-9a47-307dee4ac4bc" released by "delete_volume" :: held 2.266s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (b557f4ee-4096-4354-98be-f3c52b1ff39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb29524-ea03-4cc7-9413-05ef59ba8fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb29524-ea03-4cc7-9413-05ef59ba8fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-665824414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065ad44d-0efb-4756-8d29-4191b4dfce26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:02Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f4b169-2168-4265-8c49-9b530167742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f4b169-2168-4265-8c49-9b530167742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd5f079-78b7-4ac1-9d97-bec159a124bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd5f079-78b7-4ac1-9d97-bec159a124bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065ad44d-0efb-4756-8d29-4191b4dfce26', 'volume_name': 'volume-065ad44d-0efb-4756-8d29-4191b4dfce26', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e906c231-d231-44d2-b475-2187b96f1309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e906c231-d231-44d2-b475-2187b96f1309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab13a74d-5dc3-4cc6-9a8a-64689a23eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume 065ad44d-0efb-4756-8d29-4191b4dfce26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065ad44d-0efb-4756-8d29-4191b4dfce26', 'volume_size': 1} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Created reservations ['5224e5d4-525b-4a9e-932b-e715f4a94834'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:02 devstack cinder-volume[86966]: WARNING cinder.quota [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1691699160 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1691699160, it is now deprecated. Please use the default quota class for default quota. Jul 03 12:51:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Created reservations ['ee331002-e3ea-41f3-b3fd-41f26b9be1e3', '8d86b530-6e77-42ad-900c-c8926e3f02b5', 'bdb5ded8-9666-40bd-a975-ab8d58709fb0', 'a8fa1fa2-0d2e-4010-bdc1-3ce9fb8064dc'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:03 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.093s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:03 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2" returned: 0 in 1.228s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.573s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-665824414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065ad44d-0efb-4756-8d29-4191b4dfce26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:02Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating volume 065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:03 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:03 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 1073741824 Jul 03 12:51:03 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ead6aa-7a3f-47e4-a30f-c93c3fe95987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:03 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:03 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87a269c-251b-4723-8b62-e2aafb36a41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:03 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Volume volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 (565a9d12-ffb9-4369-b817-e0d9098fc0f2): created successfully Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87a269c-251b-4723-8b62-e2aafb36a41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Flow 'volume_create_manager' (f1c716e0-84c4-4984-bfde-648ce593b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:03 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd 1G" returned: 0 in 1.035s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-725c9123-70d3-4941-9fd9-f92e560f19a1 tempest-AttachVolumeTestJSON-1380958095 None] Created volume successfully. Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7ebf5-e09b-458a-940a-de60336f7c5f]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:03 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:51:03 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:04 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:04 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a260711a-1025-493d-945b-e7cdf3395cc5 tempest-GroupSnapshotsV319Test-415226885 None] Delete group completed successfully. Jul 03 12:51:04 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 1073741824" returned: 0 in 1.170s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:04 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:04 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:04 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 0 in 1.110s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:04 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:51:04 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:05 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab13a74d-5dc3-4cc6-9a8a-64689a23eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065ad44d-0efb-4756-8d29-4191b4dfce26', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584d25fb-0d24-4380-abf7-fcfaa1a1f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume volume-065ad44d-0efb-4756-8d29-4191b4dfce26 (065ad44d-0efb-4756-8d29-4191b4dfce26): created successfully Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584d25fb-0d24-4380-abf7-fcfaa1a1f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (b557f4ee-4096-4354-98be-f3c52b1ff39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-05c32d09-b461-40e1-9671-aa44dde32d94 tempest-VolumesSnapshotTestJSON-1059001696 None] Created volume successfully. Jul 03 12:51:05 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 1 in 0.960s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Downloaded image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume 2a085541-3f56-44d5-ab87-3b6094424bcd successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b for user a27bf90f27d74ee79fad293172a8c9e0 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Marking volume 2a085541-3f56-44d5-ab87-3b6094424bcd as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Copying metadata from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b to 2a085541-3f56-44d5-ab87-3b6094424bcd. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Creating volume glance metadata for volume 2a085541-3f56-44d5-ab87-3b6094424bcd backed by image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafe1999-aaf8-474c-811f-d4b5c8a40c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a085541-3f56-44d5-ab87-3b6094424bcd', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c008778c-1857-4af4-a81b-f53feb6ae6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Volume volume-2a085541-3f56-44d5-ab87-3b6094424bcd (2a085541-3f56-44d5-ab87-3b6094424bcd): created successfully Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c008778c-1857-4af4-a81b-f53feb6ae6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Flow 'volume_create_manager' (737f03a9-7c0a-4d0c-9cf0-a2b967bdeea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d78a20bc-1643-40ac-a314-17ea6f1d4553 tempest-VolumesImageMetadata-1730298271 None] Created volume successfully. Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating offline snapshot 99b60ac7-234e-40b1-9c10-a33f16571de6 of volume 065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc2220d-81f3-4f8b-8d7a-df313a355abc]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:06 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:06 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Acquiring lock "cinder-2a085541-3f56-44d5-ab87-3b6094424bcd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Lock "cinder-2a085541-3f56-44d5-ab87-3b6094424bcd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Acquiring lock "cinder-quobyte-2a085541-3f56-44d5-ab87-3b6094424bcd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Lock "cinder-quobyte-2a085541-3f56-44d5-ab87-3b6094424bcd" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239c91a-cfe1-423f-aba9-e6e59cf63c99]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:07 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:51:07 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:07 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 1.160s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:07 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 1G Jul 03 12:51:07 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:08 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 0 in 1.091s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:08 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:51:08 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:08 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 1G" returned: 0 in 1.050s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065ad44d-0efb-4756-8d29-4191b4dfce26 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:08 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065ad44d-0efb-4756-8d29-4191b4dfce26 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 Jul 03 12:51:08 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:08 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 1 in 0.954s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:09 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd Jul 03 12:51:09 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:09 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065ad44d-0efb-4756-8d29-4191b4dfce26 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:09 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 is being set with open permissions: ugo+rw Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:09 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 Jul 03 12:51:09 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:09 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2a085541-3f56-44d5-ab87-3b6094424bcd" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Lock "cinder-quobyte-2a085541-3f56-44d5-ab87-3b6094424bcd" released by "delete_volume" :: held 2.985s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Created reservations ['1c2da6d4-d69e-430b-9e37-1a87d45f61a6', 'd914ee9b-f76a-440d-8be9-0d57f6d16c02', '708a8a09-0079-49e8-b88d-8678ed6a5d2f', 'e34273c9-07e8-4fe4-9a03-5de59fe7e49b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:09 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6" returned: 0 in 0.749s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:10 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:10 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:10 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:10 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:10 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.794s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Deleted volume successfully. Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b75f983-71e2-4fcd-8217-faf6c19381ed tempest-VolumesImageMetadata-1730298271 None] Lock "cinder-2a085541-3f56-44d5-ab87-3b6094424bcd-delete_volume" released by "delete_volume" :: held 4.166s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:10 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info" returned: 0 in 1.010s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:10 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info is being set with open permissions: ugo+rw Jul 03 12:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:11 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info Jul 03 12:51:11 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.info" returned: 0 in 0.825s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:11 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.795s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.604s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4b886-3348-43b4-9743-b75ac697142b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9a953218-3d80-4eb1-b16c-95dc3a466861 tempest-VolumesSnapshotTestJSON-1059001696 None] Create snapshot completed successfully Jul 03 12:51:12 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 Jul 03 12:51:12 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:13 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2" returned: 0 in 1.155s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.197s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80ae67b1-caa2-49e6-8384-a651ced9b0fd', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:51:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-3bc43195-21e2-4045-9abd-5ed58a45677b req-6fd16846-668a-4241-9f8b-a79a44c5741d tempest-AttachVolumeTestJSON-1380958095 None] attachment_update completed successfully. Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (f4a4c494-edb6-45e2-871e-a924909b6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3975db5c-a35a-4b57-8a67-eb76a4c30cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3975db5c-a35a-4b57-8a67-eb76a4c30cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106983134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73a67a3-17cd-4a77-82a0-8c13fc1ef54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df076844e3346a5bcdcc70e7c1c1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99b60ac7-234e-40b1-9c10-a33f16571de6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:13Z,use_quota=True,user_id='3f68cb4d4b2749debf1b12449e191797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b9d67c-f915-46b7-952b-c3bb8c3b0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b9d67c-f915-46b7-952b-c3bb8c3b0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7a901a-7344-44a7-8a15-2d38b5c73bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7a901a-7344-44a7-8a15-2d38b5c73bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a73a67a3-17cd-4a77-82a0-8c13fc1ef54d', 'volume_name': 'volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d', 'volume_size': 1, 'snapshot_id': '99b60ac7-234e-40b1-9c10-a33f16571de6'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b924cdf0-9ce4-4dc4-b427-77040ab8d560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b924cdf0-9ce4-4dc4-b427-77040ab8d560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bb4f48-0ccc-4245-aa52-19aa8927c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume a73a67a3-17cd-4a77-82a0-8c13fc1ef54d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d', 'volume_size': 1, 'snapshot_id': '99b60ac7-234e-40b1-9c10-a33f16571de6'} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-99b60ac7-234e-40b1-9c10-a33f16571de6-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-99b60ac7-234e-40b1-9c10-a33f16571de6-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating volume a73a67a3-17cd-4a77-82a0-8c13fc1ef54d from snapshot 99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] snapshot: 99b60ac7-234e-40b1-9c10-a33f16571de6, volume: a73a67a3-17cd-4a77-82a0-8c13fc1ef54d, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ca8bb-9b12-40a1-9b1c-38466ebb7749]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:14 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 Jul 03 12:51:14 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:15 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6" returned: 0 in 1.232s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065ad44d-0efb-4756-8d29-4191b4dfce26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:51:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:51:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4093f99-5c49-485b-b142-48d964f50949]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:15 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:15 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:16 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 1.033s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:16 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d Jul 03 12:51:16 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Flow 'volume_create_manager' (12ee859a-88ca-40f9-9df8-ba921e0c3818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6452e7-e199-4394-9e55-8159d44f54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6452e7-e199-4394-9e55-8159d44f54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1719954988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6074927b-520d-47f1-a737-78cfb89c45c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9eaceeeb94f5fb6cd29d12a0f6470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:16Z,use_quota=True,user_id='328de267cf4a455aa3b1cec5e439eb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eacb4f5-93e1-4c50-8c92-bf788ff709ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eacb4f5-93e1-4c50-8c92-bf788ff709ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb3efcd-a6cc-4e44-865b-8318c89b3dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb3efcd-a6cc-4e44-865b-8318c89b3dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6074927b-520d-47f1-a737-78cfb89c45c0', 'volume_name': 'volume-6074927b-520d-47f1-a737-78cfb89c45c0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed813d6-8931-4ab7-b00b-12e4e0a1d38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed813d6-8931-4ab7-b00b-12e4e0a1d38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0378dfc3-09f6-48fb-87f8-fa22ab87a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Volume 6074927b-520d-47f1-a737-78cfb89c45c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6074927b-520d-47f1-a737-78cfb89c45c0', 'volume_size': 1} Jul 03 12:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Flow 'volume_create_manager' (3b2239eb-9516-4c08-acf9-0ec1258596da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ba89cb-683d-4ae0-8c90-1323ba7fc425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ba89cb-683d-4ae0-8c90-1323ba7fc425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-21425646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d17f80-8da3-4890-bcc5-e9b3b5e8dadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c05674b4294c55ba172b3f51132852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:20Z,use_quota=True,user_id='11c3d9a48ca845838732678015dc40a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5fa83-d90d-45cb-ad69-ccd95a5d0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5fa83-d90d-45cb-ad69-ccd95a5d0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260418ed-5df2-4a94-8fe9-c56967cef46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260418ed-5df2-4a94-8fe9-c56967cef46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d17f80-8da3-4890-bcc5-e9b3b5e8dadb', 'volume_name': 'volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0c27a0-f752-4b22-a88e-e25633af4115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0c27a0-f752-4b22-a88e-e25633af4115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f381a43e-fdcb-4706-a90d-dd940598ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb', 'volume_size': 1} Jul 03 12:51:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:22 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" returned: 0 in 6.598s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d64366-ce0c-4a4d-8efd-87312262d43c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:22 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:22 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:23 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 1.050s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:23 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:51:23 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Converted 1024.00 MB image at 155.17 MB/s Jul 03 12:51:23 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d is being set with open permissions: ugo+rw Jul 03 12:51:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:23 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d Jul 03 12:51:23 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:24 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" returned: 0 in 0.694s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" released by "_copy_volume_from_snapshot" :: held 10.739s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-99b60ac7-234e-40b1-9c10-a33f16571de6-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" released by "_create_volume_from_snapshot" :: held 10.778s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.799s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.231s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1719954988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6074927b-520d-47f1-a737-78cfb89c45c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9eaceeeb94f5fb6cd29d12a0f6470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:16Z,use_quota=True,user_id='328de267cf4a455aa3b1cec5e439eb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Creating volume 6074927b-520d-47f1-a737-78cfb89c45c0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:24 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:24 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 1073741824 Jul 03 12:51:24 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bb4f48-0ccc-4245-aa52-19aa8927c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d', 'volume_size': 1, 'snapshot_id': '99b60ac7-234e-40b1-9c10-a33f16571de6'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e629a1-90e9-4c63-ba4c-9c220551998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Volume volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d (a73a67a3-17cd-4a77-82a0-8c13fc1ef54d): created successfully Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e629a1-90e9-4c63-ba4c-9c220551998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Flow 'volume_create_manager' (f4a4c494-edb6-45e2-871e-a924909b6d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-76da15be-349d-4a50-9242-439ce7ed1cb4 tempest-VolumesSnapshotTestJSON-1059001696 None] Created volume successfully. Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc25ce-24fb-40d1-81c6-3ec84a97119a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:25 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d Jul 03 12:51:25 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:25 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 1073741824" returned: 0 in 1.061s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:25 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 Jul 03 12:51:25 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:26 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" returned: 0 in 0.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:26 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d Jul 03 12:51:26 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:26 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0" returned: 0 in 0.844s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.975s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-21425646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d17f80-8da3-4890-bcc5-e9b3b5e8dadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c05674b4294c55ba172b3f51132852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:20Z,use_quota=True,user_id='11c3d9a48ca845838732678015dc40a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Creating volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:26 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0378dfc3-09f6-48fb-87f8-fa22ab87a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6074927b-520d-47f1-a737-78cfb89c45c0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fea1e0-5b45-49fb-b6e5-94c886d3147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:26 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb 1073741824 Jul 03 12:51:26 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Volume volume-6074927b-520d-47f1-a737-78cfb89c45c0 (6074927b-520d-47f1-a737-78cfb89c45c0): created successfully Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fea1e0-5b45-49fb-b6e5-94c886d3147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Flow 'volume_create_manager' (12ee859a-88ca-40f9-9df8-ba921e0c3818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7956c915-5f35-4e79-a339-74d15b295422 tempest-AbsoluteLimitsTests-1574043309 None] Created volume successfully. Jul 03 12:51:26 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d" released by "delete_volume" :: held 1.830s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['ff78c697-ebaf-41af-9bb4-d03eae6e47bf', '4d30c8d4-a450-4471-851a-d047229e3f4d', 'f4865c09-8fb8-4556-b5ad-30120e9b3169', '42cab642-ab10-4142-bf44-c08d404ab782'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:27 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:27 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-99b60ac7-234e-40b1-9c10-a33f16571de6-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-99b60ac7-234e-40b1-9c10-a33f16571de6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-065ad44d-0efb-4756-8d29-4191b4dfce26" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-065ad44d-0efb-4756-8d29-4191b4dfce26" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-99b60ac7-234e-40b1-9c10-a33f16571de6" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-99b60ac7-234e-40b1-9c10-a33f16571de6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Deleting offline snapshot 99b60ac7-234e-40b1-9c10-a33f16571de6 of volume 065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] snapshot_file for this snap is: volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Acquiring lock "cinder-6074927b-520d-47f1-a737-78cfb89c45c0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Lock "cinder-6074927b-520d-47f1-a737-78cfb89c45c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[91674e08-2cab-4baf-be5c-2568998d04da]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Acquiring lock "cinder-quobyte-6074927b-520d-47f1-a737-78cfb89c45c0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:27 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Lock "cinder-quobyte-6074927b-520d-47f1-a737-78cfb89c45c0" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb 1073741824" returned: 0 in 1.133s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342bf09-baa6-4f96-87eb-20071d40d4e8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:27 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 Jul 03 12:51:27 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:27 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb Jul 03 12:51:27 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:27 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 Jul 03 12:51:27 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:28 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.985s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Deleted volume successfully. Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-67434467-c3de-49ed-893c-29c2761d8d73 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-a73a67a3-17cd-4a77-82a0-8c13fc1ef54d-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:28 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6" returned: 0 in 1.005s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065ad44d-0efb-4756-8d29-4191b4dfce26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8654d87-de15-4d49-9542-88f0f5658e3b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:28 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f381a43e-fdcb-4706-a90d-dd940598ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:28 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:28 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2493233b-db13-435b-94dc-56d9c6a5ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Volume volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb (47d17f80-8da3-4890-bcc5-e9b3b5e8dadb): created successfully Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2493233b-db13-435b-94dc-56d9c6a5ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Flow 'volume_create_manager' (3b2239eb-9516-4c08-acf9-0ec1258596da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-829cd8fa-fb3b-4782-9c74-7515f8f6004c tempest-SnapshotsActionsTest-1070126714 None] Created volume successfully. Jul 03 12:51:28 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0" returned: 0 in 1.141s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:28 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0 Jul 03 12:51:28 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Creating offline snapshot 3752d3a4-c957-4dbc-a5ce-6bcc757503bd of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aececb9-8f38-480d-85d1-a29764cadafd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:29 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb Jul 03 12:51:29 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:29 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 1.100s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:29 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-6074927b-520d-47f1-a737-78cfb89c45c0" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:29 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 Jul 03 12:51:29 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Lock "cinder-quobyte-6074927b-520d-47f1-a737-78cfb89c45c0" released by "delete_volume" :: held 2.085s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Created reservations ['afeb8cc4-13bf-4304-b1bf-b9e94cc9a54d', '9a0f8b2c-2128-457d-95db-303e691af2ce', '24183055-4d64-4b64-ab29-1a722da8c056', 'f3a00dfc-33f2-4bfd-8eed-b6da82ec3b6a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:29 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:29 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:30 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" returned: 0 in 1.015s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:30 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd 1G Jul 03 12:51:30 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:30 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6" returned: 0 in 0.951s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:30 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6 Jul 03 12:51:30 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:30 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Deleted volume successfully. Jul 03 12:51:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96b7e52e-5716-46ed-aa80-8014d54101d0 tempest-AbsoluteLimitsTests-1574043309 None] Lock "cinder-6074927b-520d-47f1-a737-78cfb89c45c0-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:31 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd 1G" returned: 0 in 1.000s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:31 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:51:31 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:31 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26.99b60ac7-234e-40b1-9c10-a33f16571de6" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-99b60ac7-234e-40b1-9c10-a33f16571de6" released by "_delete_snapshot" :: held 4.031s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-065ad44d-0efb-4756-8d29-4191b4dfce26" released by "delete_snapshot" :: held 4.064s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['7f707871-efd1-46f0-b9b7-c1a1a04cc6ef', '06ed57c0-628b-45a1-930a-371e68cb5ee2', '6b4ac5ea-ad7c-4dd6-81a4-5155b4993b9d', '1322924e-5e63-465d-ba9a-b7d335002d67'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Delete snapshot completed successfully. Jul 03 12:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8f51a4fc-ab76-43e5-8950-a68120302555 tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-99b60ac7-234e-40b1-9c10-a33f16571de6-delete_snapshot" released by "delete_snapshot" :: held 4.283s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:32 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 0.922s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:32 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd is being set with open permissions: ugo+rw Jul 03 12:51:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:32 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:51:32 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-065ad44d-0efb-4756-8d29-4191b4dfce26-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-065ad44d-0efb-4756-8d29-4191b4dfce26-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-065ad44d-0efb-4756-8d29-4191b4dfce26" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-065ad44d-0efb-4756-8d29-4191b4dfce26" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c3a9c5-353a-458d-a896-a62c18406448]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:33 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:33 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:33 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.398s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:33 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info Jul 03 12:51:33 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:34 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 1.286s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:34 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26 Jul 03 12:51:34 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:35 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info" returned: 0 in 1.449s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:35 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info is being set with open permissions: ugo+rw Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:35 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info Jul 03 12:51:35 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:35 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-065ad44d-0efb-4756-8d29-4191b4dfce26" returned: 0 in 0.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-065ad44d-0efb-4756-8d29-4191b4dfce26" released by "delete_volume" :: held 2.357s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['5eb72462-637b-4f26-97e2-ae53704be1ab', '6086a260-00e5-4918-b83d-bf694d237392', '029f281e-c11c-4ca1-abf6-6b8146c31bff', 'edd44e0f-38bc-49af-b378-85367cc5cbfc'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:35 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:35 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:36 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.info" returned: 0 in 1.229s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.238s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6ca205cc-1fdf-4b4a-b1d5-fa289ffa57bc tempest-SnapshotsActionsTest-1070126714 None] Create snapshot completed successfully Jul 03 12:51:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-c0f85748-d612-4a1d-ada2-11496d08b1f7-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-c0f85748-d612-4a1d-ada2-11496d08b1f7-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "cinder-quobyte-c0f85748-d612-4a1d-ada2-11496d08b1f7" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-c0f85748-d612-4a1d-ada2-11496d08b1f7" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d37de-7756-4749-9726-3e33c982d119]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:37 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.383s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Deleted volume successfully. Jul 03 12:51:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-93af8d50-b241-4c55-a809-399b789dc98c tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-065ad44d-0efb-4756-8d29-4191b4dfce26-delete_volume" released by "delete_volume" :: held 4.188s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:37 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 Jul 03 12:51:37 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Creating offline snapshot cb5fd33f-a7ec-4116-a5cd-32132575a3fb of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2029ff9-f966-41b9-ad2e-cda01066a7f4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:38 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7" returned: 0 in 1.240s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:38 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7 Jul 03 12:51:38 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:38 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:51:38 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:39 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c0f85748-d612-4a1d-ada2-11496d08b1f7" returned: 0 in 1.000s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-quobyte-c0f85748-d612-4a1d-ada2-11496d08b1f7" released by "delete_volume" :: held 2.353s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:39 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.073s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:39 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb 1G Jul 03 12:51:39 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Created reservations ['69b58c0a-d1ed-48b2-963f-26910632a178', '9ff43ad3-3b26-4e77-ab0e-6521730de95d', '15a9850a-f3ff-4869-a44c-ba0956f4ccdd', '61457067-1d4a-4ab4-b1a5-8f6f5c41b0ac'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:39 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:51:39 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:40 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.960s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:51:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Deleted volume successfully. Jul 03 12:51:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7233985f-2c7a-4772-84ff-d4b64aa76afa tempest-VolumesSnapshotTestJSON-1059001696 None] Lock "cinder-c0f85748-d612-4a1d-ada2-11496d08b1f7-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:40 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb 1G" returned: 0 in 1.331s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:40 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb Jul 03 12:51:40 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:41 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:41 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb is being set with open permissions: ugo+rw Jul 03 12:51:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:41 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb Jul 03 12:51:41 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:42 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb" returned: 0 in 0.963s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fdc787bb-9193-4780-898a-d8554e024efb tempest-SnapshotsActionsTest-1070126714 None] Create snapshot completed successfully Jul 03 12:51:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-cb5fd33f-a7ec-4116-a5cd-32132575a3fb-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-cb5fd33f-a7ec-4116-a5cd-32132575a3fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-cb5fd33f-a7ec-4116-a5cd-32132575a3fb" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-cb5fd33f-a7ec-4116-a5cd-32132575a3fb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Deleting offline snapshot cb5fd33f-a7ec-4116-a5cd-32132575a3fb of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:51:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] snapshot_file for this snap is: volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:51:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c96ae-0e0a-41a5-82ef-4637467eaadb]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:44 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb Jul 03 12:51:44 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:45 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb" returned: 0 in 1.541s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d46c559-524f-44b9-b46e-deda433b5b3e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:45 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:51:45 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:47 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.425s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:47 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb Jul 03 12:51:47 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:48 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb" returned: 0 in 1.622s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:48 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb Jul 03 12:51:48 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:49 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.cb5fd33f-a7ec-4116-a5cd-32132575a3fb" returned: 0 in 1.176s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-cb5fd33f-a7ec-4116-a5cd-32132575a3fb" released by "_delete_snapshot" :: held 5.960s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" released by "delete_snapshot" :: held 6.018s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:49 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=107,cinder:UPDATE=113,cinder:DELETE=8,cinder:INSERT=36 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:51:50 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=111,cinder:SELECT=100,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:51:50 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Created reservations ['18e2da01-19f6-453a-b607-26f7f37e3f80', '9128e1c3-e97c-4b79-8319-519e7a09212e', 'ce67e526-a542-48fb-afba-8d1b7057bf20', '4a0cabdf-a7df-47e5-b635-d64ce24711ac'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:51:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Delete snapshot completed successfully. Jul 03 12:51:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e1cd2cbd-44ed-4a7c-b58a-7918eeffa012 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-cb5fd33f-a7ec-4116-a5cd-32132575a3fb-delete_snapshot" released by "delete_snapshot" :: held 6.272s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Creating offline snapshot 04ff0d29-65d8-4cac-832d-791f73e0f560 of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:51:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae013a0c-e7a0-4f73-b6b2-319e62e43d0e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:51 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:51:51 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:52 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.209s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:52 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 1G Jul 03 12:51:52 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:53 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 1G" returned: 0 in 1.119s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:53 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 Jul 03 12:51:53 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Flow 'volume_create_manager' (e36af61e-ab58-442c-8b54-2660c2a6898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28d179b-136d-4c00-80e2-67cbb0d53114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28d179b-136d-4c00-80e2-67cbb0d53114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343004271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0676f8-3ca9-454f-ae6e-e16ff19a72ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bb9e882a5746be8a4017d641514dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:53Z,use_quota=True,user_id='ca4cf2613512468da93154e7dfd4dbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d3671a-7de0-410f-9403-292c3ee1ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d3671a-7de0-410f-9403-292c3ee1ba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53d938b-0d75-4388-869a-eaec4a6abc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53d938b-0d75-4388-869a-eaec4a6abc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0676f8-3ca9-454f-ae6e-e16ff19a72ae', 'volume_name': 'volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff332acd-27ad-4664-b7b4-de7c19c2a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff332acd-27ad-4664-b7b4-de7c19c2a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80de07e5-60d1-45da-9d67-aa4db6538e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Volume 8f0676f8-3ca9-454f-ae6e-e16ff19a72ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae', 'volume_size': 1} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Flow 'volume_create_manager' (386ec5cd-b114-49e4-a208-d54a9c0eda7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8745253-f374-4f67-a51a-5371e03fb4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8745253-f374-4f67-a51a-5371e03fb4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-542381373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f3c6d9-9693-402e-bcab-470b17772e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5de950a72c41bca0a1f680f95b3a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:54Z,use_quota=True,user_id='18aa4cdb24ea40bb8da3654b8f376f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbaf3a08-cebb-43db-9ec7-b28ff694286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbaf3a08-cebb-43db-9ec7-b28ff694286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5e91db-9e85-4b5d-a99d-5893bedf78bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5e91db-9e85-4b5d-a99d-5893bedf78bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f3c6d9-9693-402e-bcab-470b17772e55', 'volume_name': 'volume-35f3c6d9-9693-402e-bcab-470b17772e55', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f62dcb-0396-439b-8adc-31a39a32cfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f62dcb-0396-439b-8adc-31a39a32cfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15be08f7-1cb2-42ad-b7d9-0b2fbaf7ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Volume 35f3c6d9-9693-402e-bcab-470b17772e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f3c6d9-9693-402e-bcab-470b17772e55', 'volume_size': 1} Jul 03 12:51:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:54 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 is being set with open permissions: ugo+rw Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:54 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 Jul 03 12:51:54 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:54 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.902s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343004271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0676f8-3ca9-454f-ae6e-e16ff19a72ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bb9e882a5746be8a4017d641514dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:53Z,use_quota=True,user_id='ca4cf2613512468da93154e7dfd4dbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Creating volume 8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:54 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:51:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:55 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae 1073741824 Jul 03 12:51:55 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5151a3a8-b5ff-402d-8130-daf4e8b45417 tempest-SnapshotsActionsTest-1070126714 None] Create snapshot completed successfully Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-04ff0d29-65d8-4cac-832d-791f73e0f560-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-04ff0d29-65d8-4cac-832d-791f73e0f560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-04ff0d29-65d8-4cac-832d-791f73e0f560" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-04ff0d29-65d8-4cac-832d-791f73e0f560" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Deleting offline snapshot 04ff0d29-65d8-4cac-832d-791f73e0f560 of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] snapshot_file for this snap is: volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadb1278-87ac-4b0a-9c1f-08038e95b89d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:55 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 Jul 03 12:51:55 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:56 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae 1073741824" returned: 0 in 1.195s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:56 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:51:56 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:56 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560" returned: 0 in 0.991s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c0559-0aea-4871-83c1-8b034245465e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:51:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:56 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:51:56 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:57 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.242s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-542381373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f3c6d9-9693-402e-bcab-470b17772e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5de950a72c41bca0a1f680f95b3a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:54Z,use_quota=True,user_id='18aa4cdb24ea40bb8da3654b8f376f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Creating volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:51:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80de07e5-60d1-45da-9d67-aa4db6538e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ef9b76-4da0-445c-aa59-879bd6bdcc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:57 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 1073741824 Jul 03 12:51:57 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Volume volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae (8f0676f8-3ca9-454f-ae6e-e16ff19a72ae): created successfully Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ef9b76-4da0-445c-aa59-879bd6bdcc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Flow 'volume_create_manager' (e36af61e-ab58-442c-8b54-2660c2a6898a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-81baf6a8-2dba-4467-acd2-e837af0e263a tempest-VolumesActionsTest-975251853 None] Created volume successfully. Jul 03 12:51:57 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 0.994s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:57 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 Jul 03 12:51:57 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:58 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 1073741824" returned: 0 in 1.407s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:58 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 Jul 03 12:51:58 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:58 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560" returned: 0 in 1.244s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:51:58 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560 Jul 03 12:51:58 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:51:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-2c7a411d-d869-488a-9200-c2c7f0e95916 req-1062a3da-c86f-4ade-ad77-fe56aaaeae55 tempest-AttachVolumeTestJSON-1380958095 None] Terminate volume connection completed successfully. Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-2c7a411d-d869-488a-9200-c2c7f0e95916 req-1062a3da-c86f-4ade-ad77-fe56aaaeae55 tempest-AttachVolumeTestJSON-1380958095 None] Deleting attachment 80ae67b1-caa2-49e6-8384-a651ced9b0fd. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:51:59 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55" returned: 0 in 1.108s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] <== create_volume: return (2583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.586s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15be08f7-1cb2-42ad-b7d9-0b2fbaf7ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f3c6d9-9693-402e-bcab-470b17772e55', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6c5361-9b4d-4696-9417-d3004a425167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:51:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Volume volume-35f3c6d9-9693-402e-bcab-470b17772e55 (35f3c6d9-9693-402e-bcab-470b17772e55): created successfully Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6c5361-9b4d-4696-9417-d3004a425167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Flow 'volume_create_manager' (386ec5cd-b114-49e4-a208-d54a9c0eda7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:51:59 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.04ff0d29-65d8-4cac-832d-791f73e0f560" returned: 0 in 0.899s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:51:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8379d38c-51f0-4d8d-8c45-e41ae1389009 tempest-VolumesSnapshotListTestJSON-519297599 None] Created volume successfully. Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-04ff0d29-65d8-4cac-832d-791f73e0f560" released by "_delete_snapshot" :: held 4.277s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" released by "delete_snapshot" :: held 4.319s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:51:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Created reservations ['1bc3190d-5892-489a-b510-2b59eeaf28fe', '86b4de28-d983-42da-93cb-9f44bf36d0f9', '08db742a-1752-45d6-831a-a712db588b42', '15c95e7a-afdb-43d6-9581-551cf6858373'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Delete snapshot completed successfully. Jul 03 12:52:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a7d68e4-0ab8-4808-8202-ff1ba0e0eeb9 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-04ff0d29-65d8-4cac-832d-791f73e0f560-delete_snapshot" released by "delete_snapshot" :: held 4.544s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Creating offline snapshot d36bd906-2f51-408c-8857-2a7bf0c57e9a of volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:52:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7970d725-b958-4361-98ef-0ae068a028d8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:00 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 Jul 03 12:52:00 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:01 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55" returned: 0 in 1.036s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:01 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a 1G Jul 03 12:52:01 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:01 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:52:01 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a 1G" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:02 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:02 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:02 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:03 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.184s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:52:03 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 1.217s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a is being set with open permissions: ugo+rw Jul 03 12:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:03 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:03 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:04 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 0.759s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:04 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info Jul 03 12:52:04 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:04 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:04 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info is being set with open permissions: ugo+rw Jul 03 12:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:04 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info Jul 03 12:52:04 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:05 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.info" returned: 0 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.715s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.667s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Creating offline snapshot 6ed284f1-fa1b-462b-9b0e-24b222c8a7ba of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:52:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e11c2ddb-a922-43d9-b659-dba1710574bb tempest-VolumesSnapshotListTestJSON-519297599 None] Create snapshot completed successfully Jul 03 12:52:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedde746-fd4f-491e-9688-1f3f998d46fe]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:06 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:06 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:07 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.046s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:07 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba 1G Jul 03 12:52:07 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:08 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba 1G" returned: 0 in 1.093s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:08 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba Jul 03 12:52:08 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:08 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba is being set with open permissions: ugo+rw Jul 03 12:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:08 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba Jul 03 12:52:08 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:09 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" returned: 0 in 0.712s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.795s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.860s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Creating offline snapshot fffaf93a-b587-4b94-b6ec-486f9daa3408 of volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:52:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-db58a795-84b7-4f3f-bf4a-e77329406d0e tempest-SnapshotsActionsTest-1070126714 None] Create snapshot completed successfully Jul 03 12:52:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9bdef-e185-4557-a86f-dd22ed129450]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:09 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:09 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:10 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 0.966s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:10 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 1G Jul 03 12:52:10 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-6ed284f1-fa1b-462b-9b0e-24b222c8a7ba-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-6ed284f1-fa1b-462b-9b0e-24b222c8a7ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Deleting offline snapshot 6ed284f1-fa1b-462b-9b0e-24b222c8a7ba of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] snapshot_file for this snap is: volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3842db6-1fc8-459f-abb9-d2655114ecb3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:11 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba Jul 03 12:52:11 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:11 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 1G" returned: 0 in 1.054s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:11 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:11 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:11 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f83d86c-eb34-49f2-8c5b-656a650f95e5]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:12 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:12 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:12 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 0.842s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:12 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 is being set with open permissions: ugo+rw Jul 03 12:52:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:12 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:12 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:12 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 0.983s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:13 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba Jul 03 12:52:13 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:14 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 2.202s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.296s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fce54dac-56e5-4707-92e9-587e7232bde3 tempest-VolumesSnapshotListTestJSON-519297599 None] Create snapshot completed successfully Jul 03 12:52:15 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" returned: 0 in 2.709s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:15 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba Jul 03 12:52:15 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Creating offline snapshot e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 of volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:52:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f569a3-794f-444d-b2d2-b712f4ab9dc8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:16 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:16 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:17 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" returned: 0 in 1.628s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-6ed284f1-fa1b-462b-9b0e-24b222c8a7ba" released by "_delete_snapshot" :: held 6.416s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" released by "delete_snapshot" :: held 6.457s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Created reservations ['d178bf5a-dc6e-460d-884b-a05aa1112d5e', '7288fb22-2f42-4500-b63f-6e7bf32d96d4', '30b0ed76-c789-4c56-8d04-0febf6d2475c', 'b86dede2-6719-4047-8b4f-b08b382fee7c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Delete snapshot completed successfully. Jul 03 12:52:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d44b217d-ce90-4dd8-b752-c05524bfd509 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-6ed284f1-fa1b-462b-9b0e-24b222c8a7ba-delete_snapshot" released by "delete_snapshot" :: held 6.819s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-32aa5cf4-43ee-47d8-b968-38c6225d3d2a tempest-VolumesActionsTest-975251853 None] Acquiring lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" by "attach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-32aa5cf4-43ee-47d8-b968-38c6225d3d2a tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" acquired by "attach_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:18 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 1.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-32aa5cf4-43ee-47d8-b968-38c6225d3d2a tempest-VolumesActionsTest-975251853 None] Attaching volume 8f0676f8-3ca9-454f-ae6e-e16ff19a72ae to instance f0cdc962-031c-448d-9e38-795d8d5d02ff at mountpoint /dev/vdb on host None. Jul 03 12:52:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-32aa5cf4-43ee-47d8-b968-38c6225d3d2a tempest-VolumesActionsTest-975251853 None] Attach volume completed successfully. Jul 03 12:52:18 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 1G Jul 03 12:52:18 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-32aa5cf4-43ee-47d8-b968-38c6225d3d2a tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" released by "attach_volume" :: held 0.222s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b77c17e7-b6b0-449f-85b6-be4af34b002e tempest-VolumesActionsTest-975251853 None] Acquiring lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b77c17e7-b6b0-449f-85b6-be4af34b002e tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b77c17e7-b6b0-449f-85b6-be4af34b002e tempest-VolumesActionsTest-975251853 None] Detaching volume 8f0676f8-3ca9-454f-ae6e-e16ff19a72ae from instance f0cdc962-031c-448d-9e38-795d8d5d02ff. Jul 03 12:52:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b77c17e7-b6b0-449f-85b6-be4af34b002e tempest-VolumesActionsTest-975251853 None] Detach volume completed successfully. Jul 03 12:52:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b77c17e7-b6b0-449f-85b6-be4af34b002e tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:20 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 1G" returned: 0 in 1.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:20 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 Jul 03 12:52:20 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:21 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" returned: 0 in 1.116s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:21 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 is being set with open permissions: ugo+rw Jul 03 12:52:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:21 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 Jul 03 12:52:21 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:22 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" returned: 0 in 0.883s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.124s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.095s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Creating offline snapshot 0b72d940-f662-4893-9ee1-7f5988172802 of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:52:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-af36c252-b5e9-46df-94e9-737169141496 tempest-VolumesSnapshotListTestJSON-519297599 None] Create snapshot completed successfully Jul 03 12:52:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4261f269-0b8f-4cda-828a-ed2a7484687b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:22 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:22 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:24 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.587s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:24 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 1G Jul 03 12:52:24 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Deleting offline snapshot e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 of volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] snapshot_file for this snap is: volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa0759-b70f-4897-a92c-638285839a26]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:24 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 Jul 03 12:52:24 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:25 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 1G" returned: 0 in 1.080s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:25 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 Jul 03 12:52:25 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:25 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" returned: 0 in 1.391s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4dd042-2ccf-4f3d-9914-62d44cb1a227]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:26 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:26 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:26 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802" returned: 0 in 1.081s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:26 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 is being set with open permissions: ugo+rw Jul 03 12:52:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:26 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 Jul 03 12:52:26 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:26 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 1.082s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:27 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 Jul 03 12:52:27 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:27 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802" returned: 0 in 0.839s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-da5431c5-c96f-47e9-ad04-20252cb4533d tempest-SnapshotsActionsTest-1070126714 None] Create snapshot completed successfully Jul 03 12:52:27 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" returned: 0 in 0.998s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:28 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35 Jul 03 12:52:28 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-0b72d940-f662-4893-9ee1-7f5988172802-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-0b72d940-f662-4893-9ee1-7f5988172802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Acquiring lock "cinder-quobyte-0b72d940-f662-4893-9ee1-7f5988172802" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-0b72d940-f662-4893-9ee1-7f5988172802" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Deleting offline snapshot 0b72d940-f662-4893-9ee1-7f5988172802 of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] snapshot_file for this snap is: volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece0314-8cbd-4c3d-8840-d51962e35f31]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:28 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 Jul 03 12:52:28 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:28 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" returned: 0 in 0.924s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35" released by "_delete_snapshot" :: held 4.563s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" released by "delete_snapshot" :: held 4.600s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Created reservations ['4de4199a-18c8-4f6c-8363-218bce557f7e', '1b34eaf7-b236-4627-9626-6da345f3ecfe', '7830482f-3328-4f05-9723-9136c9cb3af6', '70c01215-73fd-40d1-892f-82b4c656c722'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Delete snapshot completed successfully. Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cd131a7-db3c-4948-9310-f40c6de5a18d tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-e6c97c01-6f1d-4ba0-ac9f-3ebea7e81f35-delete_snapshot" released by "delete_snapshot" :: held 4.789s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:29 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802" returned: 0 in 1.183s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2a66df-12f4-437a-bef6-2230c60a66e5]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:29 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:29 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-fffaf93a-b587-4b94-b6ec-486f9daa3408-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-fffaf93a-b587-4b94-b6ec-486f9daa3408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-fffaf93a-b587-4b94-b6ec-486f9daa3408" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-fffaf93a-b587-4b94-b6ec-486f9daa3408" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Deleting offline snapshot fffaf93a-b587-4b94-b6ec-486f9daa3408 of volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] snapshot_file for this snap is: volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[05996bdb-e89f-46b0-b1db-80985dfcb17e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:30 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:30 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:30 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.078s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:30 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 Jul 03 12:52:30 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:30 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 1.039s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c444c2d-be64-4448-b650-92d9a4877045]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:31 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:31 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:31 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802" returned: 0 in 0.906s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:31 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802 Jul 03 12:52:31 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:31 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:31 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:31 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:32 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.0b72d940-f662-4893-9ee1-7f5988172802" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-0b72d940-f662-4893-9ee1-7f5988172802" released by "_delete_snapshot" :: held 4.037s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" released by "delete_snapshot" :: held 4.068s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Created reservations ['a70a595a-4508-40ae-bcb1-b32157ac053a', '320d0ab4-71f4-4034-ab7c-d4b986ab8fc2', '8cc912c3-9b00-4f3b-b1b0-d5e40a99a7a7', 'b32e81ba-579e-40d9-b77b-93cd6f5f919b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Delete snapshot completed successfully. Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4719e57f-6c70-422f-b6e3-7fc7fe4d25a0 tempest-SnapshotsActionsTest-1995016615 None] Lock "cinder-0b72d940-f662-4893-9ee1-7f5988172802-delete_snapshot" released by "delete_snapshot" :: held 4.263s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:32 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:32 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408 Jul 03 12:52:32 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:33 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.fffaf93a-b587-4b94-b6ec-486f9daa3408" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-fffaf93a-b587-4b94-b6ec-486f9daa3408" released by "_delete_snapshot" :: held 3.716s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" released by "delete_snapshot" :: held 3.744s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Created reservations ['a60256b8-4fc2-4226-941b-edbeee5d7cc9', 'db352164-2d0c-4e4e-82d9-9a1e3287fe6c', 'c4fe2d96-9800-428b-9e6c-6d1c20ee77f5', '00429daa-d46d-4a5a-8978-50962bd21443'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Delete snapshot completed successfully. Jul 03 12:52:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38a9d54e-359d-4258-9505-b77e317187d8 tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-fffaf93a-b587-4b94-b6ec-486f9daa3408-delete_snapshot" released by "delete_snapshot" :: held 3.935s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-d36bd906-2f51-408c-8857-2a7bf0c57e9a-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "cinder-3752d3a4-c957-4dbc-a5ce-6bcc757503bd-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-d36bd906-2f51-408c-8857-2a7bf0c57e9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-3752d3a4-c957-4dbc-a5ce-6bcc757503bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-d36bd906-2f51-408c-8857-2a7bf0c57e9a" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "cinder-quobyte-3752d3a4-c957-4dbc-a5ce-6bcc757503bd" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-quobyte-3752d3a4-c957-4dbc-a5ce-6bcc757503bd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Deleting offline snapshot 3752d3a4-c957-4dbc-a5ce-6bcc757503bd of volume 47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] snapshot_file for this snap is: volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-d36bd906-2f51-408c-8857-2a7bf0c57e9a" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Deleting offline snapshot d36bd906-2f51-408c-8857-2a7bf0c57e9a of volume 35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] snapshot_file for this snap is: volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b141c8-4911-45b3-8dda-349d892d9666]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dbf2fd-8d75-426f-94cc-592c17af53d3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:34 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:34 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:34 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:34 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:35 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 1.024s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f3c6d9-9693-402e-bcab-470b17772e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac4ea8-e0f2-488e-8cff-5e565e20b7a8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:35 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.105s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad30907c-2edd-4412-bace-1e47efbb16bb]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:35 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 Jul 03 12:52:35 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:35 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb Jul 03 12:52:35 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:36 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55" returned: 0 in 1.132s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:36 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" returned: 0 in 1.089s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:36 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:36 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:36 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:36 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:37 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 1.060s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:37 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 1.097s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:37 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd Jul 03 12:52:37 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:37 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a Jul 03 12:52:37 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:38 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb.3752d3a4-c957-4dbc-a5ce-6bcc757503bd" returned: 0 in 0.896s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-quobyte-3752d3a4-c957-4dbc-a5ce-6bcc757503bd" released by "_delete_snapshot" :: held 4.345s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" released by "delete_snapshot" :: held 4.389s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:38 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55.d36bd906-2f51-408c-8857-2a7bf0c57e9a" returned: 0 in 0.974s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-d36bd906-2f51-408c-8857-2a7bf0c57e9a" released by "_delete_snapshot" :: held 4.407s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" released by "delete_snapshot" :: held 4.489s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Created reservations ['e92a2a4d-3dd1-45db-8903-d25b41b1e02d', 'bff384ee-c9e6-4a69-abff-4b66fd8f1f3c', '7ab47673-3db5-4d9a-b694-37ad3102055e', '96923cff-5fbf-4c4b-ba36-7fb4fb3bc73e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Created reservations ['ecfb5744-9b2f-465a-9f54-ee0b8954841d', '51f527e5-2b71-4fc6-a7a3-1c3ff4e34ae0', '1e3fcbec-e23c-486f-b968-67fc79209ef0', 'b0d4c0d7-73e8-4a5c-a49d-b6c0e0331cba'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Delete snapshot completed successfully. Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f1f7da77-0ce8-4846-8b27-d97376feb456 tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-3752d3a4-c957-4dbc-a5ce-6bcc757503bd-delete_snapshot" released by "delete_snapshot" :: held 4.688s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Delete snapshot completed successfully. Jul 03 12:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-720dc1aa-0357-4e3f-aaba-6a402516919c tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-d36bd906-2f51-408c-8857-2a7bf0c57e9a-delete_snapshot" released by "delete_snapshot" :: held 4.739s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-35f3c6d9-9693-402e-bcab-470b17772e55-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-35f3c6d9-9693-402e-bcab-470b17772e55-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "cinder-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" acquired by "delete_volume" :: waited 0.043s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[47748f72-37a4-4394-bdf1-3df489f5fa63]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88100e-8a4c-40c2-aecf-96c38b741e3b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:40 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 Jul 03 12:52:40 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:40 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb Jul 03 12:52:40 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:40 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55" returned: 0 in 0.998s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:40 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" returned: 0 in 0.916s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:40 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55 Jul 03 12:52:40 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:40 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb Jul 03 12:52:40 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:41 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" returned: 0 in 1.072s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:41 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-35f3c6d9-9693-402e-bcab-470b17772e55" returned: 0 in 1.118s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-quobyte-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb" released by "delete_volume" :: held 2.120s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-quobyte-35f3c6d9-9693-402e-bcab-470b17772e55" released by "delete_volume" :: held 2.244s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Created reservations ['6370110c-7f99-493f-905a-74ac1a166bf9', '87e1f28e-6c63-4a9a-9607-ae6d0ceb432a', '861c8a87-8189-4ead-b01d-1ea5cb2c9654', 'e71ac70d-d258-42cc-ad38-06cb8caab189'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Created reservations ['3d853d8f-bd23-402c-8284-a4db75bc4297', 'cdc47d6b-0071-484a-b58a-796ca1b13a6c', '707c2063-5f95-4395-a2bb-ac264282bbc9', '10c05c63-9c9d-4741-8a7f-fe30c3787093'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:42 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:52:42 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:42 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:52:42 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:43 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.263s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:52:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Deleted volume successfully. Jul 03 12:52:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-179aef30-6c63-4e3d-aeeb-99b679adf1be tempest-VolumesSnapshotListTestJSON-519297599 None] Lock "cinder-35f3c6d9-9693-402e-bcab-470b17772e55-delete_volume" released by "delete_volume" :: held 3.999s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:43 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.411s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:52:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Deleted volume successfully. Jul 03 12:52:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c8f02c8e-b0fa-403f-9c2e-900fb04ec14e tempest-SnapshotsActionsTest-1070126714 None] Lock "cinder-47d17f80-8da3-4890-bcc5-e9b3b5e8dadb-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fcda53e5-1241-4018-84f2-ba7c527bed7a tempest-VolumesActionsTest-975251853 None] Acquiring lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" by "attach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fcda53e5-1241-4018-84f2-ba7c527bed7a tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" acquired by "attach_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcda53e5-1241-4018-84f2-ba7c527bed7a tempest-VolumesActionsTest-975251853 None] Attaching volume 8f0676f8-3ca9-454f-ae6e-e16ff19a72ae to instance a42dd2fb-15aa-42be-bec1-b449cd52b1c5 at mountpoint /dev/vdb on host None. Jul 03 12:52:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcda53e5-1241-4018-84f2-ba7c527bed7a tempest-VolumesActionsTest-975251853 None] Attach volume completed successfully. Jul 03 12:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fcda53e5-1241-4018-84f2-ba7c527bed7a tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" released by "attach_volume" :: held 0.108s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-743df683-0836-4017-8425-bc123cef5b37 tempest-VolumesActionsTest-975251853 None] Acquiring lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-743df683-0836-4017-8425-bc123cef5b37 tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-743df683-0836-4017-8425-bc123cef5b37 tempest-VolumesActionsTest-975251853 None] Detaching volume 8f0676f8-3ca9-454f-ae6e-e16ff19a72ae from instance a42dd2fb-15aa-42be-bec1-b449cd52b1c5. Jul 03 12:52:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-743df683-0836-4017-8425-bc123cef5b37 tempest-VolumesActionsTest-975251853 None] Detach volume completed successfully. Jul 03 12:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-743df683-0836-4017-8425-bc123cef5b37 tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Flow 'volume_create_manager' (2f9e7580-8cce-4c39-9b7d-011a0b63abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7d1550-4658-4dfe-89cf-5e92581d3d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7d1550-4658-4dfe-89cf-5e92581d3d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-261442444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4252b64-4ef4-4f04-a69e-dff4ae4b54ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc03600164146afa000d34922989861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:49Z,use_quota=True,user_id='24fe1ebc7e5a4403bfe749497aea9282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe6e623-cc7d-4f4c-b965-81c722dd080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe6e623-cc7d-4f4c-b965-81c722dd080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bed499-6bb6-48ec-8d71-7edb6773fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bed499-6bb6-48ec-8d71-7edb6773fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4252b64-4ef4-4f04-a69e-dff4ae4b54ea', 'volume_name': 'volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f704a160-892b-4302-be1a-7924eb8d829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f704a160-892b-4302-be1a-7924eb8d829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3ed6d6-76bf-46b6-bbde-f07d50fde46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:52:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Volume a4252b64-4ef4-4f04-a69e-dff4ae4b54ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea', 'volume_size': 2} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-261442444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4252b64-4ef4-4f04-a69e-dff4ae4b54ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc03600164146afa000d34922989861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:49Z,use_quota=True,user_id='24fe1ebc7e5a4403bfe749497aea9282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Creating volume a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:52:49 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea 2147483648 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:49 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea 2147483648 Jul 03 12:52:49 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:50 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea 2147483648" returned: 0 in 1.370s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:50 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:52:50 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=83,cinder:INSERT=26,cinder:UPDATE=79,cinder:DELETE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:52:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:50 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea Jul 03 12:52:50 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:51 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] <== create_volume: return (2441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3ed6d6-76bf-46b6-bbde-f07d50fde46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52fc6d1-d442-4278-9c6e-9a31ef50d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:52:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Volume volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea (a4252b64-4ef4-4f04-a69e-dff4ae4b54ea): created successfully Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52fc6d1-d442-4278-9c6e-9a31ef50d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:52:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Flow 'volume_create_manager' (2f9e7580-8cce-4c39-9b7d-011a0b63abc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:52:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-76a23b33-5e28-4c56-b810-2d95a2aa1f36 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Created volume successfully. Jul 03 12:52:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Creating offline snapshot 52df4e91-023b-4b40-ad86-f069c0e3b73f of volume a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:52:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b28508b-9376-4984-913e-61a3c95e609b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:53 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea Jul 03 12:52:53 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:54 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" returned: 0 in 1.062s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f 2G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:54 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f 2G Jul 03 12:52:54 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:55 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f 2G" returned: 0 in 1.118s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:55 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f Jul 03 12:52:55 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:56 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:56 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f is being set with open permissions: ugo+rw Jul 03 12:52:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:56 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f Jul 03 12:52:56 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:57 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:57 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info Jul 03 12:52:57 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:58 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info" returned: 0 in 0.899s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:58 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info is being set with open permissions: ugo+rw Jul 03 12:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:58 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info Jul 03 12:52:58 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:59 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.info" returned: 0 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.897s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:52:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f2ad3100-66cc-4441-8530-1dfe49800978 tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Create snapshot completed successfully Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "cinder-52df4e91-023b-4b40-ad86-f069c0e3b73f-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-52df4e91-023b-4b40-ad86-f069c0e3b73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "cinder-quobyte-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-quobyte-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "cinder-quobyte-52df4e91-023b-4b40-ad86-f069c0e3b73f" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-quobyte-52df4e91-023b-4b40-ad86-f069c0e3b73f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Deleting offline snapshot 52df4e91-023b-4b40-ad86-f069c0e3b73f of volume a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] snapshot_file for this snap is: volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa8432-4ef7-4ec4-8de5-cb87a55193e1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:52:59 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f Jul 03 12:52:59 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cbb9a4-ad40-4b71-8c36-48234a32cc15]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:00 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:53:00 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:00 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f" returned: 0 in 1.098s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf3ae2-5196-4566-aca9-ab5f2d30fef2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:00 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 1.029s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e81c307-60a8-45b3-8123-16dc85eba88e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:01 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea Jul 03 12:53:01 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:01 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:53:01 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:01 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" returned: 0 in 0.994s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:01 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f Jul 03 12:53:01 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:53:01 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 0.987s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.294d0ecd-b744-487b-a1fb-da1ee64cb2a6p0_2pbl5.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:02 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:53:02 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:02 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.294d0ecd-b744-487b-a1fb-da1ee64cb2a6p0_2pbl5.img Jul 03 12:53:02 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:03 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f" returned: 0 in 1.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:03 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:53:03 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f Jul 03 12:53:03 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:06 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea.52df4e91-023b-4b40-ad86-f069c0e3b73f" returned: 0 in 2.573s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-quobyte-52df4e91-023b-4b40-ad86-f069c0e3b73f" released by "_delete_snapshot" :: held 6.733s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:53:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-quobyte-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" released by "delete_snapshot" :: held 6.786s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:53:06 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Created reservations ['2c525673-72ab-4da4-ba22-31409acd9459', '6e703a92-c171-44d2-bba4-a8ba62f8e51f', '2eb77cfc-79ff-4853-bbe2-7865d6b72c50', '23dd0209-eb8d-40f1-a67b-1ec5e708c6e4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:53:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Delete snapshot completed successfully. Jul 03 12:53:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-73d2c955-6d1b-4bd1-af9e-536bcf6e1d6e tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-52df4e91-023b-4b40-ad86-f069c0e3b73f-delete_snapshot" released by "delete_snapshot" :: held 7.217s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:53:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "cinder-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:53:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:53:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "cinder-quobyte-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:53:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-quobyte-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" acquired by "delete_volume" :: waited 0.051s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:53:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[203ef2b3-eaf8-430a-a7dc-59c9938e3767]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:08 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea Jul 03 12:53:08 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:09 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.294d0ecd-b744-487b-a1fb-da1ee64cb2a6p0_2pbl5.img" returned: 0 in 7.413s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3abcd7-e58e-465e-a160-6ef4d585b7f6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:09 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:53:09 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:09 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" returned: 0 in 1.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:09 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea Jul 03 12:53:09 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:10 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-quobyte-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea" released by "delete_volume" :: held 2.816s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:53:10 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 1.256s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.294d0ecd-b744-487b-a1fb-da1ee64cb2a6p0_2pbl5.img {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:53:10 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Converted 1024.00 MB image at 138.11 MB/s Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] 294d0ecd-b744-487b-a1fb-da1ee64cb2a6 was raw, no need to convert to raw {{(pid=86966) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Created reservations ['d4194efb-4eaf-482e-81d8-6d5d01e62c78', '37a64188-e436-4574-8c4a-c6655a82bd79', 'c49f841d-f1d7-40c1-bf91-2aa1830a15c7', '33805947-0897-4291-b15b-eff8edd4031f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:10 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:53:10 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:12 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.176s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:53:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Deleted volume successfully. Jul 03 12:53:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ba9122b-30a1-43e6-9e3c-6f228ade69fa tempest-VolumesSnapshotNegativeTestJSON-1482718915 None] Lock "cinder-a4252b64-4ef4-4f04-a69e-dff4ae4b54ea-delete_volume" released by "delete_volume" :: held 4.514s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Flow 'volume_create_manager' (79551284-556f-47a2-9a01-3cf419bda11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361cfc3-4c3c-499b-8915-0ee92ec8086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361cfc3-4c3c-499b-8915-0ee92ec8086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-681921010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=103f8867-6d9d-4f96-9277-382ec51388d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6483a90d92742ed840f322368b253ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:18Z,use_quota=True,user_id='54186486740d4cbe897247a8f806eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7a665c-b7ae-4a17-9e99-a590dbe28754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7a665c-b7ae-4a17-9e99-a590dbe28754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66018fb-0789-4384-bf2b-0f10a66e461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66018fb-0789-4384-bf2b-0f10a66e461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '103f8867-6d9d-4f96-9277-382ec51388d3', 'volume_name': 'volume-103f8867-6d9d-4f96-9277-382ec51388d3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb6ccbb-fa51-4c8c-af46-51cd1c25c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb6ccbb-fa51-4c8c-af46-51cd1c25c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bbcfed-6f74-4d9e-a967-258e03316858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Volume 103f8867-6d9d-4f96-9277-382ec51388d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-103f8867-6d9d-4f96-9277-382ec51388d3', 'volume_size': 1} Jul 03 12:53:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=19,cinder:SELECT=18,cinder:INSERT=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:53:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Flow 'volume_create_manager' (b64e5fac-672f-41b0-870c-021df9af2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f849eb9-c5de-49b1-adac-7a1b4fc0e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f849eb9-c5de-49b1-adac-7a1b4fc0e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1680305151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ba06b6-7be2-4dcb-949b-ac8daa45aa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d1407663c444078ba4e679a0cdd983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:41Z,use_quota=True,user_id='c34433e493f84dcda6dc9c48f0e947ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731bf9f9-8013-4725-93b7-30f31d15f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731bf9f9-8013-4725-93b7-30f31d15f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f701d30-76ab-45f7-b921-6a733d353dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f701d30-76ab-45f7-b921-6a733d353dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ba06b6-7be2-4dcb-949b-ac8daa45aa00', 'volume_name': 'volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13085a9-4ecf-4e96-a678-3337b8f2fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13085a9-4ecf-4e96-a678-3337b8f2fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4e1b48-54ba-4ad3-980c-2956668c1cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Volume d7ba06b6-7be2-4dcb-949b-ac8daa45aa00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00', 'volume_size': 1} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.828s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Uploaded volume to glance image-id: 294d0ecd-b744-487b-a1fb-da1ee64cb2a6. {{(pid=86966) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.700s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-681921010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=103f8867-6d9d-4f96-9277-382ec51388d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6483a90d92742ed840f322368b253ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:18Z,use_quota=True,user_id='54186486740d4cbe897247a8f806eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Creating volume 103f8867-6d9d-4f96-9277-382ec51388d3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:53:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:41 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 1073741824 Jul 03 12:53:41 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-29eedaae-dbff-4c48-a3f5-1fc96d18c8e5 tempest-VolumesActionsTest-975251853 None] Copy volume to image completed successfully. Jul 03 12:53:42 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 1073741824" returned: 0 in 1.100s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:42 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 Jul 03 12:53:42 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:43 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.206s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1680305151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ba06b6-7be2-4dcb-949b-ac8daa45aa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d1407663c444078ba4e679a0cdd983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:41Z,use_quota=True,user_id='c34433e493f84dcda6dc9c48f0e947ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Creating volume d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:53:43 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:43 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 1073741824 Jul 03 12:53:43 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bbcfed-6f74-4d9e-a967-258e03316858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-103f8867-6d9d-4f96-9277-382ec51388d3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41b1ac1-9eba-4474-827c-cb267b9d64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Volume volume-103f8867-6d9d-4f96-9277-382ec51388d3 (103f8867-6d9d-4f96-9277-382ec51388d3): created successfully Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41b1ac1-9eba-4474-827c-cb267b9d64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Flow 'volume_create_manager' (79551284-556f-47a2-9a01-3cf419bda11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:53:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3daca7f0-1ad9-435e-b550-01b5dc186918 tempest-VolumesListAdminTestJSON-974900062 None] Created volume successfully. Jul 03 12:53:44 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 1073741824" returned: 0 in 1.118s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:45 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 Jul 03 12:53:45 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Flow 'volume_create_manager' (88cfc01b-178b-433d-8b8a-ef75cbfad5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e816fdd-b6fb-4276-a06f-6d9a70aa9eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e816fdd-b6fb-4276-a06f-6d9a70aa9eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1075232866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685b5e66-11e2-4f5a-8779-323fbf971fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6483a90d92742ed840f322368b253ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:46Z,use_quota=True,user_id='54186486740d4cbe897247a8f806eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2da47a-b844-4cdd-afaa-c3ac4a5d9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2da47a-b844-4cdd-afaa-c3ac4a5d9a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46be9ad-0616-4ccd-bc84-67cde0fed68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46be9ad-0616-4ccd-bc84-67cde0fed68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685b5e66-11e2-4f5a-8779-323fbf971fe3', 'volume_name': 'volume-685b5e66-11e2-4f5a-8779-323fbf971fe3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8877f2f-70aa-454b-8f73-c375d034ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8877f2f-70aa-454b-8f73-c375d034ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1f2aef-b798-4155-8156-07e93a9fae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Volume 685b5e66-11e2-4f5a-8779-323fbf971fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685b5e66-11e2-4f5a-8779-323fbf971fe3', 'volume_size': 1} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:45 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" returned: 0 in 0.922s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.123s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4e1b48-54ba-4ad3-980c-2956668c1cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b6058d-53b7-4a8f-a5d0-834d2da26ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0904fa7-3213-4cb4-a478-e4034336e417]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Volume volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 (d7ba06b6-7be2-4dcb-949b-ac8daa45aa00): created successfully Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b6058d-53b7-4a8f-a5d0-834d2da26ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Flow 'volume_create_manager' (b64e5fac-672f-41b0-870c-021df9af2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:53:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0e6b94d4-d9ca-49a8-8353-e741164ee57d tempest-AttachVolumeTestJSON-1380958095 None] Created volume successfully. Jul 03 12:53:46 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:53:46 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:46 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6249b5e-8529-4629-a199-0e70ceb7a1f4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:47 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:53:47 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:47 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:47 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img Jul 03 12:53:47 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Flow 'volume_create_manager' (294bc8c1-8d8d-44cc-b9ad-c56d08300b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28ea4eb-fbe0-4373-831b-56b7370d51a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28ea4eb-fbe0-4373-831b-56b7370d51a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1607965262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e344fca5-d494-4b16-be50-264f2fd3a10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1c63f32de64851b562f6e45eb8b409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:51Z,use_quota=True,user_id='de430d5d337a449aa0d0d4dc5e433623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797e06eb-3467-47cc-92dc-4fce54eadedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797e06eb-3467-47cc-92dc-4fce54eadedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f861b1d9-0ecd-4080-afd2-0ea8bf1b47f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:51 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 12:53:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f861b1d9-0ecd-4080-afd2-0ea8bf1b47f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e344fca5-d494-4b16-be50-264f2fd3a10d', 'volume_name': 'volume-e344fca5-d494-4b16-be50-264f2fd3a10d', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa9548-19a9-4121-a0a1-a0f7b42572c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa9548-19a9-4121-a0a1-a0f7b42572c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:53:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ef4ba-4027-48ec-afd4-f3ad84089352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:53:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Volume e344fca5-d494-4b16-be50-264f2fd3a10d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e344fca5-d494-4b16-be50-264f2fd3a10d', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 12:53:52 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Trying to clone e344fca5-d494-4b16-be50-264f2fd3a10d from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 12:53:53 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 12:53:53 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Image download 20.69 MB at 20.69 MB/s Jul 03 12:53:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d4613-6b30-42c2-8529-3c34afe5b864]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:53 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img" returned: 0 in 5.742s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c8700-75e6-4ba3-a70b-fe004b4278b6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:53 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD Jul 03 12:53:53 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:53 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:53:53 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:54 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b is fetched for user de430d5d337a449aa0d0d4dc5e433623. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b74a225-1fc1-460a-be31-c474162addaf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:54 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD Jul 03 12:53:54 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:54 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:53:54 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Converted 1024.00 MB image at 178.28 MB/s Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] 77cf927a-7f17-4e3d-a284-0069127510bb was raw, converting to qcow2 {{(pid=86966) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a91fff-0a8b-422c-8967-40cd026eefa6]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:54 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img Jul 03 12:53:54 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:55 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:55 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:55 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img Jul 03 12:53:55 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:56 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img" returned: 1 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:56 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f Jul 03 12:53:56 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:57 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:57 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Image conversion details: src /opt/stack/data/cinder/conversion/8f0676f8-3ca9-454f-ae6e-e16ff19a72ae.temp_image.77cf927a-7f17-4e3d-a284-0069127510bb9umr3ft2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:53:57 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 12:53:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d073b2-3bbc-4b09-bfd9-e7f2b6cba54d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:57 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f Jul 03 12:53:57 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:57 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 03 12:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hmvfrs4f" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.500s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Uploaded volume to glance image-id: 77cf927a-7f17-4e3d-a284-0069127510bb. {{(pid=86966) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.641s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1075232866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685b5e66-11e2-4f5a-8779-323fbf971fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6483a90d92742ed840f322368b253ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:46Z,use_quota=True,user_id='54186486740d4cbe897247a8f806eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Creating volume 685b5e66-11e2-4f5a-8779-323fbf971fe3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:53:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:53:59 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 1073741824 Jul 03 12:53:59 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:53:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c4e79631-2375-46af-bc80-6cb310b773c8 tempest-VolumesActionsTest-975251853 None] Copy volume to image completed successfully. Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Acquiring lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:00 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Acquiring lock "cinder-quobyte-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 1073741824" returned: 0 in 1.057s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Lock "cinder-quobyte-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe431ce-f620-492f-abb5-1574c5fc483a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:00 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 Jul 03 12:54:00 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:00 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:54:00 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:01 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3" returned: 0 in 0.784s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.634s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1f2aef-b798-4155-8156-07e93a9fae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685b5e66-11e2-4f5a-8779-323fbf971fe3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7f966e-996a-45ae-ac85-15a4f08ac211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc6fc2-59f7-4e91-8da9-2aa3044c6989]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Volume volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 (685b5e66-11e2-4f5a-8779-323fbf971fe3): created successfully Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7f966e-996a-45ae-ac85-15a4f08ac211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Flow 'volume_create_manager' (88cfc01b-178b-433d-8b8a-ef75cbfad5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:01 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-56209a37-9931-4cc3-afc3-d435ede1bb52 tempest-VolumesListAdminTestJSON-974900062 None] Created volume successfully. Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:01 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae Jul 03 12:54:01 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:01 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 Jul 03 12:54:01 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:01 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:01 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:02 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" returned: 0 in 0.794s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Lock "cinder-quobyte-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae" released by "delete_volume" :: held 1.793s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:02 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" returned: 0 in 0.943s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.054s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1607965262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e344fca5-d494-4b16-be50-264f2fd3a10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1c63f32de64851b562f6e45eb8b409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:51Z,use_quota=True,user_id='de430d5d337a449aa0d0d4dc5e433623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Creating volume e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:02 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d 1073741824 Jul 03 12:54:02 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d56abcf-e605-4f56-9465-9fa5f871c054', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Created reservations ['7702f243-939d-460d-a9d7-6e01d9504d05', '250117f6-4b38-4d3e-9833-f4db571c9aff', '8b8fd131-0acd-4fd9-86b0-588c391b2bb8', '92308112-f5ff-45a0-a94d-d435bb0c67fd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-75677bc4-bab2-44a5-a72c-d09cb82191b6 req-630f0616-99ed-4336-82e1-bea553dbe5ef tempest-AttachVolumeTestJSON-1380958095 None] attachment_update completed successfully. Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:02 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:02 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:03 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.052s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Flow 'volume_create_manager' (565600b1-ceb2-4090-997d-1a3cb50ee5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b373bd-0835-46d4-ac46-d2639f6ee203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b373bd-0835-46d4-ac46-d2639f6ee203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1246067664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e8cbde-e7db-4d07-b6fc-8931e58e32c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6483a90d92742ed840f322368b253ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:03Z,use_quota=True,user_id='54186486740d4cbe897247a8f806eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b3c83d-610d-4ac0-a234-b4b872c614dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b3c83d-610d-4ac0-a234-b4b872c614dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c08c89-0a8e-4df1-9096-37d0de5bd89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c08c89-0a8e-4df1-9096-37d0de5bd89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e8cbde-e7db-4d07-b6fc-8931e58e32c4', 'volume_name': 'volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbb8e64-2713-4efd-bffa-8188c8b98005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbb8e64-2713-4efd-bffa-8188c8b98005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfeae111-13a1-4012-889e-b4765924a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:03 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Volume 90e8cbde-e7db-4d07-b6fc-8931e58e32c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4', 'volume_size': 1} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:03 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d 1073741824" returned: 0 in 1.268s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:03 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.067s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Deleted volume successfully. Jul 03 12:54:03 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:54:03 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-91791004-81bb-440e-9d7a-9b9ce2caefb5 tempest-VolumesActionsTest-975251853 None] Lock "cinder-8f0676f8-3ca9-454f-ae6e-e16ff19a72ae-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:04 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.197s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1246067664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e8cbde-e7db-4d07-b6fc-8931e58e32c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6483a90d92742ed840f322368b253ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:03Z,use_quota=True,user_id='54186486740d4cbe897247a8f806eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Creating volume 90e8cbde-e7db-4d07-b6fc-8931e58e32c4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:04 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:04 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 1073741824 Jul 03 12:54:04 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Attempting download of 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume e344fca5-d494-4b16-be50-264f2fd3a10d. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15d90e-35bc-4a06-967a-44ed6a0efb9a]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:04 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze Jul 03 12:54:04 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:05 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:05 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 1073741824" returned: 0 in 1.053s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:05 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze Jul 03 12:54:05 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:05 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 Jul 03 12:54:05 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:06 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfeae111-13a1-4012-889e-b4765924a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b787e3f-f2c5-4aa5-8c38-b5282cac113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:06 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze" returned: 1 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_88ki63ze' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b36fa-a74e-48b7-8b52-a43395444b97]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Volume volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 (90e8cbde-e7db-4d07-b6fc-8931e58e32c4): created successfully Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b787e3f-f2c5-4aa5-8c38-b5282cac113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Flow 'volume_create_manager' (565600b1-ceb2-4090-997d-1a3cb50ee5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-64b2677d-d666-4a8d-86f5-b37f531c3a56 tempest-VolumesListAdminTestJSON-974900062 None] Created volume successfully. Jul 03 12:54:06 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD Jul 03 12:54:06 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:07 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:07 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] 8afb0fcf-aee7-4200-b86c-2c05ba162c4b was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 12:54:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:07 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:54:07 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Flow 'volume_create_manager' (e4f7a449-3ec6-484d-af98-a62cfcc0ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6729dc7c-5d9e-4b1a-a9ea-83e55dc8b62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6729dc7c-5d9e-4b1a-a9ea-83e55dc8b62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1818241626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac2dd15-78d9-4e27-9397-831002ffeb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d1407663c444078ba4e679a0cdd983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:08Z,use_quota=True,user_id='c34433e493f84dcda6dc9c48f0e947ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cfe037-85cd-4b8a-bcd8-bc8a364e60e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cfe037-85cd-4b8a-bcd8-bc8a364e60e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828b5e8-105c-4874-85b8-bb427f19ba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828b5e8-105c-4874-85b8-bb427f19ba07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac2dd15-78d9-4e27-9397-831002ffeb78', 'volume_name': 'volume-4ac2dd15-78d9-4e27-9397-831002ffeb78', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82b316-69d7-4024-8fb0-65e651deed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82b316-69d7-4024-8fb0-65e651deed4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fba6ab-a018-45a7-8072-877b2f21c4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Volume 4ac2dd15-78d9-4e27-9397-831002ffeb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac2dd15-78d9-4e27-9397-831002ffeb78', 'volume_size': 1} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1818241626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac2dd15-78d9-4e27-9397-831002ffeb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d1407663c444078ba4e679a0cdd983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:08Z,use_quota=True,user_id='c34433e493f84dcda6dc9c48f0e947ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Creating volume 4ac2dd15-78d9-4e27-9397-831002ffeb78 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:08 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:08 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 1073741824 Jul 03 12:54:08 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Flow 'volume_create_manager' (1cf904ee-2740-42db-9d2c-73202c7a6d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb76aee3-2fa4-4c79-a6db-19109e31d746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb76aee3-2fa4-4c79-a6db-19109e31d746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298238d1-8deb-489a-9209-ec39f5a652c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ecff2a8a894f32b3dc72e0c010afc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:09Z,use_quota=True,user_id='65e80d9ab31d4f649b92ce71ce9c3232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859e00c5-edce-4e7e-95d0-e9edc1daff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859e00c5-edce-4e7e-95d0-e9edc1daff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d529170-0525-4f4d-8f28-997cb1e49ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d529170-0525-4f4d-8f28-997cb1e49ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298238d1-8deb-489a-9209-ec39f5a652c3', 'volume_name': 'volume-298238d1-8deb-489a-9209-ec39f5a652c3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4911f74f-e0d2-4990-b11e-c84452278ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4911f74f-e0d2-4990-b11e-c84452278ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8154f17f-11d2-4e3d-8539-4a6b2dadd2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Volume 298238d1-8deb-489a-9209-ec39f5a652c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298238d1-8deb-489a-9209-ec39f5a652c3', 'volume_size': 1} Jul 03 12:54:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:09 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 1073741824" returned: 0 in 1.424s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:10 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 Jul 03 12:54:10 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:10 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 3.049s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:10 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_xyh8ggmsdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:54:10 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Converted 112.00 MB image at 36.72 MB/s Jul 03 12:54:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:10 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d 1G Jul 03 12:54:10 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:11 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78" returned: 0 in 1.028s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] <== create_volume: return (2507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.510s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.022s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298238d1-8deb-489a-9209-ec39f5a652c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ecff2a8a894f32b3dc72e0c010afc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:09Z,use_quota=True,user_id='65e80d9ab31d4f649b92ce71ce9c3232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Creating volume 298238d1-8deb-489a-9209-ec39f5a652c3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fba6ab-a018-45a7-8072-877b2f21c4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac2dd15-78d9-4e27-9397-831002ffeb78', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:11 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 1073741824 Jul 03 12:54:11 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6a1e94-bf81-4c5a-8b3a-49e1fe8d4f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Volume volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 (4ac2dd15-78d9-4e27-9397-831002ffeb78): created successfully Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6a1e94-bf81-4c5a-8b3a-49e1fe8d4f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Flow 'volume_create_manager' (e4f7a449-3ec6-484d-af98-a62cfcc0ccce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c6034bc4-af6d-42ee-b29d-1811c4905b7b tempest-AttachVolumeTestJSON-1380958095 None] Created volume successfully. Jul 03 12:54:11 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d 1G" returned: 0 in 0.971s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f224ec67-aeb7-4827-84be-37173cdd7c95]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:11 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:54:11 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Flow 'volume_create_manager' (32f7bf42-e717-4549-bc50-dbbafbf3215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d99881-69f7-4a2a-a8dc-55a31dac97c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d99881-69f7-4a2a-a8dc-55a31dac97c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2043765179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8193950f-1a96-4535-8acc-cd91fabd1bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815617be91444d44aa43bbb79c8fd593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:12Z,use_quota=True,user_id='24df61a738d145e492ec2383acd98b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8574719d-986f-42be-8dda-bab7298155b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8574719d-986f-42be-8dda-bab7298155b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d561d384-8108-4b1f-b92f-de66ea1b127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d561d384-8108-4b1f-b92f-de66ea1b127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8193950f-1a96-4535-8acc-cd91fabd1bea', 'volume_name': 'volume-8193950f-1a96-4535-8acc-cd91fabd1bea', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017fcecd-a90c-409f-9430-2b8f5a85a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017fcecd-a90c-409f-9430-2b8f5a85a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f40806-ce23-4c50-894a-e2c61bb464a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Volume 8193950f-1a96-4535-8acc-cd91fabd1bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8193950f-1a96-4535-8acc-cd91fabd1bea', 'volume_size': 1} Jul 03 12:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:12 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 1073741824" returned: 0 in 1.234s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:12 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 1.023s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:12 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 Jul 03 12:54:12 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:12 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:54:12 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:13 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2043765179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8193950f-1a96-4535-8acc-cd91fabd1bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815617be91444d44aa43bbb79c8fd593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:12Z,use_quota=True,user_id='24df61a738d145e492ec2383acd98b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Creating volume 8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:13 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:13 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea 1073741824 Jul 03 12:54:13 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8154f17f-11d2-4e3d-8539-4a6b2dadd2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298238d1-8deb-489a-9209-ec39f5a652c3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fe1a95-3486-4d16-aefb-a77fda726795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Volume volume-298238d1-8deb-489a-9209-ec39f5a652c3 (298238d1-8deb-489a-9209-ec39f5a652c3): created successfully Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fe1a95-3486-4d16-aefb-a77fda726795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Flow 'volume_create_manager' (1cf904ee-2740-42db-9d2c-73202c7a6d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ac3e084-bb7a-4f64-9aca-958c6260236b tempest-VolumesListAdminTestJSON-117328464 None] Created volume successfully. Jul 03 12:54:13 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 1 in 1.071s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Downloaded image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume e344fca5-d494-4b16-be50-264f2fd3a10d successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b for user de430d5d337a449aa0d0d4dc5e433623 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Marking volume e344fca5-d494-4b16-be50-264f2fd3a10d as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Copying metadata from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b to e344fca5-d494-4b16-be50-264f2fd3a10d. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Creating volume glance metadata for volume e344fca5-d494-4b16-be50-264f2fd3a10d backed by image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ef4ba-4027-48ec-afd4-f3ad84089352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e344fca5-d494-4b16-be50-264f2fd3a10d', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ab575d-e3ab-450e-98cc-931e4f91ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Volume volume-e344fca5-d494-4b16-be50-264f2fd3a10d (e344fca5-d494-4b16-be50-264f2fd3a10d): created successfully Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ab575d-e3ab-450e-98cc-931e4f91ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Flow 'volume_create_manager' (294bc8c1-8d8d-44cc-b9ad-c56d08300b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6b294504-979f-4f24-bfd5-303cb0f882ba tempest-TestShelveInstance-1760542803 None] Created volume successfully. Jul 03 12:54:14 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea 1073741824" returned: 0 in 1.144s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:14 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:14 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Acquiring lock "cinder-298238d1-8deb-489a-9209-ec39f5a652c3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Lock "cinder-298238d1-8deb-489a-9209-ec39f5a652c3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Acquiring lock "cinder-quobyte-298238d1-8deb-489a-9209-ec39f5a652c3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Lock "cinder-quobyte-298238d1-8deb-489a-9209-ec39f5a652c3" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff47c0c-9cfb-4488-b628-9f5f9a65a911]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "cinder-90e8cbde-e7db-4d07-b6fc-8931e58e32c4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-90e8cbde-e7db-4d07-b6fc-8931e58e32c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "cinder-quobyte-90e8cbde-e7db-4d07-b6fc-8931e58e32c4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:14 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 Jul 03 12:54:14 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-quobyte-90e8cbde-e7db-4d07-b6fc-8931e58e32c4" acquired by "delete_volume" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b70a9f-aee8-40c0-a67e-13b0b021235d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:15 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 Jul 03 12:54:15 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:15 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 1.017s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f40806-ce23-4c50-894a-e2c61bb464a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8193950f-1a96-4535-8acc-cd91fabd1bea', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453562bf-cf4b-49e7-8541-3277b2d2d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Volume volume-8193950f-1a96-4535-8acc-cd91fabd1bea (8193950f-1a96-4535-8acc-cd91fabd1bea): created successfully Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453562bf-cf4b-49e7-8541-3277b2d2d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Flow 'volume_create_manager' (32f7bf42-e717-4549-bc50-dbbafbf3215a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb19dc-1767-4a8c-8eea-142fd63f0265]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-026f8dbb-a729-44ab-bd65-c17bd0a85b37 tempest-VolumesCloneTest-2011510639 None] Created volume successfully. Jul 03 12:54:15 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 Jul 03 12:54:15 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:16 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3" returned: 0 in 1.501s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:16 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3 Jul 03 12:54:16 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:16 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4" returned: 0 in 1.629s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:16 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4 Jul 03 12:54:16 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:16 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78" returned: 0 in 1.435s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.472s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-4ac2dd15-78d9-4e27-9397-831002ffeb78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0b46679-1d04-450e-9686-c58e793fc5c5', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-3e7edcaa-2e0d-4278-9b68-5e9429dc4922 req-b26f53ae-2a6b-4a12-b70a-e884086d3cfc tempest-AttachVolumeTestJSON-1380958095 None] attachment_update completed successfully. Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Flow 'volume_create_manager' (fe857ae5-6f57-4c32-9cd7-b03aaa4d1587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7df794-a0b2-4641-9e48-7a8f7d01c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7df794-a0b2-4641-9e48-7a8f7d01c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-226834960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4bb03c-86cb-4ddc-9261-41c0eb14d619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815617be91444d44aa43bbb79c8fd593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8193950f-1a96-4535-8acc-cd91fabd1bea,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:17Z,use_quota=True,user_id='24df61a738d145e492ec2383acd98b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de51cc21-62bc-4817-80d6-d1380aca0c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de51cc21-62bc-4817-80d6-d1380aca0c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561d015a-a9c2-4325-adf9-8e90ce5da7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561d015a-a9c2-4325-adf9-8e90ce5da7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'be4bb03c-86cb-4ddc-9261-41c0eb14d619', 'volume_name': 'volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619', 'volume_size': 2, 'source_volid': '8193950f-1a96-4535-8acc-cd91fabd1bea', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4d98b0-6311-4cb0-9bbf-9e7c76463f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4d98b0-6311-4cb0-9bbf-9e7c76463f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52073f3a-c961-42ee-b37a-29ca7b2bdbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Volume be4bb03c-86cb-4ddc-9261-41c0eb14d619: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619', 'volume_size': 2, 'source_volid': '8193950f-1a96-4535-8acc-cd91fabd1bea', 'source_volstatus': 'available'} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:17 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Cloning volume 8193950f-1a96-4535-8acc-cd91fabd1bea to volume be4bb03c-86cb-4ddc-9261-41c0eb14d619 Jul 03 12:54:17 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-298238d1-8deb-489a-9209-ec39f5a652c3" returned: 0 in 1.233s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Lock "cinder-quobyte-298238d1-8deb-489a-9209-ec39f5a652c3" released by "delete_volume" :: held 2.820s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Creating offline snapshot baa8e8cc-2767-4cc3-8d0f-556203e8f969 of volume 8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ad637-d898-41dc-97e6-84eb8699d988]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Created reservations ['76bbf3fc-7d35-49c7-8015-2eec62f286fe', 'de7262b0-2ecf-4eac-874f-69de84dbf30f', '63fa5a18-86f0-4f08-a57e-a83c7dc143ec', 'fb41d894-987e-4b44-b1c1-ebbfaf142a87'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:17 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:17 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:17 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90e8cbde-e7db-4d07-b6fc-8931e58e32c4" returned: 0 in 1.030s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:17 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:17 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-quobyte-90e8cbde-e7db-4d07-b6fc-8931e58e32c4" released by "delete_volume" :: held 2.764s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Created reservations ['8e2010a5-865b-4f74-ad25-7b3f1ce3d62c', '5c54e98c-4d29-47c3-ad56-36c85be0568a', '8a35fe7d-981c-4631-bf1b-82af5994a986', '834e9df2-0618-4aae-bde3-b6d690e77b75'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:17 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:17 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "cinder-685b5e66-11e2-4f5a-8779-323fbf971fe3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-685b5e66-11e2-4f5a-8779-323fbf971fe3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:18 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:18 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 1.043s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Deleted volume successfully. Jul 03 12:54:18 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 1G Jul 03 12:54:18 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "cinder-quobyte-685b5e66-11e2-4f5a-8779-323fbf971fe3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5e9941d6-38a4-49ff-8af4-847ed0f7ce33 tempest-VolumesListAdminTestJSON-117328464 None] Lock "cinder-298238d1-8deb-489a-9209-ec39f5a652c3-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-quobyte-685b5e66-11e2-4f5a-8779-323fbf971fe3" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[96909b75-37b1-4bca-918e-d5c06ffb8ac0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:18 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Deleted volume successfully. Jul 03 12:54:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f0499a81-5cac-4200-b013-81ab630d4ef8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-90e8cbde-e7db-4d07-b6fc-8931e58e32c4-delete_volume" released by "delete_volume" :: held 4.015s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:18 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 Jul 03 12:54:18 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:19 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 1G" returned: 0 in 0.978s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8193950f-1a96-4535-8acc-cd91fabd1bea -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:19 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8193950f-1a96-4535-8acc-cd91fabd1bea -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 Jul 03 12:54:19 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:19 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3" returned: 0 in 0.892s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:19 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3 Jul 03 12:54:19 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:20 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8193950f-1a96-4535-8acc-cd91fabd1bea -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969" returned: 0 in 0.780s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:20 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 is being set with open permissions: ugo+rw Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:20 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 Jul 03 12:54:20 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:20 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-685b5e66-11e2-4f5a-8779-323fbf971fe3" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-quobyte-685b5e66-11e2-4f5a-8779-323fbf971fe3" released by "delete_volume" :: held 1.742s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Created reservations ['2a61f1f7-f463-441d-99f8-8f6ae6a9b5dd', '4e8fa49b-48ba-4a0b-a8f3-ccb639c27f40', '75564e66-499b-4d99-8990-7196d587a154', 'e4abc842-cb82-4924-8472-ee52a3f7207e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:20 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:20 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "cinder-103f8867-6d9d-4f96-9277-382ec51388d3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-103f8867-6d9d-4f96-9277-382ec51388d3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "cinder-quobyte-103f8867-6d9d-4f96-9277-382ec51388d3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-quobyte-103f8867-6d9d-4f96-9277-382ec51388d3" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f2e35-922e-4d96-973e-eca7e1e43d4f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:21 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 Jul 03 12:54:21 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:21 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969" returned: 0 in 1.010s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:21 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info Jul 03 12:54:21 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:21 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.166s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Deleted volume successfully. Jul 03 12:54:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-705b56b1-1676-4e49-865b-46152c243ad8 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-685b5e66-11e2-4f5a-8779-323fbf971fe3-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:22 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info" returned: 0 in 0.989s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:22 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info is being set with open permissions: ugo+rw Jul 03 12:54:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:22 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info Jul 03 12:54:22 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:22 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3" returned: 0 in 1.422s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:22 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3 Jul 03 12:54:22 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:23 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-103f8867-6d9d-4f96-9277-382ec51388d3" returned: 0 in 1.012s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-quobyte-103f8867-6d9d-4f96-9277-382ec51388d3" released by "delete_volume" :: held 2.506s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:23 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.info" returned: 0 in 1.218s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Acquiring lock "cinder-quobyte-be4bb03c-86cb-4ddc-9261-41c0eb14d619" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Created reservations ['21c994d7-ee35-4506-9693-cfb3ad4adce1', 'de2a5769-0c1f-4531-b5e4-507a1830cfdf', '4f8837cd-0494-48fd-bbb9-4e2a02b278f1', '6e5dcfc9-981d-4ec2-b748-5792d3907f6a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-be4bb03c-86cb-4ddc-9261-41c0eb14d619" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] snapshot: baa8e8cc-2767-4cc3-8d0f-556203e8f969, volume: be4bb03c-86cb-4ddc-9261-41c0eb14d619, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33dcceb-c463-4fc0-a7ee-cc7103eb9052]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:23 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:23 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:23 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 Jul 03 12:54:23 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-09745e72-dc77-463a-8aba-5af1776649cc req-24e50d16-7b9c-4ed7-b9a9-19f5b5c34cb1 tempest-AttachVolumeTestJSON-1380958095 None] Terminate volume connection completed successfully. Jul 03 12:54:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-09745e72-dc77-463a-8aba-5af1776649cc req-24e50d16-7b9c-4ed7-b9a9-19f5b5c34cb1 tempest-AttachVolumeTestJSON-1380958095 None] Deleting attachment 4d56abcf-e605-4f56-9465-9fa5f871c054. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:54:24 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.110s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:24 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Deleted volume successfully. Jul 03 12:54:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-132350e4-8163-4337-b043-2d274dc39db0 tempest-VolumesListAdminTestJSON-974900062 None] Lock "cinder-103f8867-6d9d-4f96-9277-382ec51388d3-delete_volume" released by "delete_volume" :: held 4.063s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:25 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969" returned: 0 in 1.445s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8193950f-1a96-4535-8acc-cd91fabd1bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:54:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:54:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:54:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96f951-d6f4-4470-a06f-f2e9c5f227f4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:25 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:25 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:26 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 1.132s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:26 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:54:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:26 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 Jul 03 12:54:26 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-bf8a3482-316d-43dd-9338-52d743ac8e05 req-b0a70ab7-131a-4ef1-92be-61b9dbe041d5 tempest-AttachVolumeTestJSON-1380958095 None] Terminate volume connection completed successfully. Jul 03 12:54:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-bf8a3482-316d-43dd-9338-52d743ac8e05 req-b0a70ab7-131a-4ef1-92be-61b9dbe041d5 tempest-AttachVolumeTestJSON-1380958095 None] Deleting attachment b0b46679-1d04-450e-9686-c58e793fc5c5. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:54:33 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619" returned: 0 in 7.420s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[177b39f5-8f92-40b6-b7d3-854f373f7d7e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:33 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:33 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:34 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 1.266s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:34 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:54:34 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Converted 1024.00 MB image at 137.97 MB/s Jul 03 12:54:34 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 is being set with open permissions: ugo+rw Jul 03 12:54:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:34 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 Jul 03 12:54:34 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Flow 'volume_create_manager' (4720b398-185a-4053-8f13-b9a88d824d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b4f358-8195-479b-92b2-119d66b337ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b4f358-8195-479b-92b2-119d66b337ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1146664635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ced0da-4b6d-428b-be5b-6dde4cc56873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bf2899d1c45a491aa667658b4417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:36Z,use_quota=True,user_id='08be85a120b14b428b2b5da5b518e708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a662f7d-78ff-4c73-bd67-cf961d8a071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a662f7d-78ff-4c73-bd67-cf961d8a071c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9d4522-5334-4906-9a08-64ac0a71492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9d4522-5334-4906-9a08-64ac0a71492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ced0da-4b6d-428b-be5b-6dde4cc56873', 'volume_name': 'volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3a956-5e10-4879-8bf5-ad2bbd670840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3a956-5e10-4879-8bf5-ad2bbd670840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13810002-fa95-4bfc-8b0a-3c631753f104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Volume c8ced0da-4b6d-428b-be5b-6dde4cc56873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873', 'volume_size': 1} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:35 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-be4bb03c-86cb-4ddc-9261-41c0eb14d619" released by "_copy_volume_from_snapshot" :: held 12.174s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Acquiring lock "cinder-quobyte-baa8e8cc-2767-4cc3-8d0f-556203e8f969" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-baa8e8cc-2767-4cc3-8d0f-556203e8f969" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Deleting offline snapshot baa8e8cc-2767-4cc3-8d0f-556203e8f969 of volume 8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] snapshot_file for this snap is: volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f062ca-183a-4403-90ca-4451b9ba1304]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:35 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 Jul 03 12:54:35 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:36 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969" returned: 0 in 0.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8193950f-1a96-4535-8acc-cd91fabd1bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:54:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0526930-d3db-43bc-bb47-2a335702fb52]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:36 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:36 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:37 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 0.948s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:37 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 Jul 03 12:54:37 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:38 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:38 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969 Jul 03 12:54:38 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:39 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea.baa8e8cc-2767-4cc3-8d0f-556203e8f969" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-baa8e8cc-2767-4cc3-8d0f-556203e8f969" released by "_delete_snapshot" :: held 3.665s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=72,cinder:SELECT=76,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=62,cinder:UPDATE=72,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.189s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.416s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52073f3a-c961-42ee-b37a-29ca7b2bdbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619', 'volume_size': 2, 'source_volid': '8193950f-1a96-4535-8acc-cd91fabd1bea', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd988385-7e4d-4679-b598-df06780df5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Volume volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 (be4bb03c-86cb-4ddc-9261-41c0eb14d619): created successfully Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd988385-7e4d-4679-b598-df06780df5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Flow 'volume_create_manager' (fe857ae5-6f57-4c32-9cd7-b03aaa4d1587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c6bb92-b4f3-4748-a9e5-0e40bb25d777]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "cinder-4ac2dd15-78d9-4e27-9397-831002ffeb78-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e9519d39-d633-4304-b11f-43ab2b6af34b tempest-VolumesCloneTest-2011510639 None] Created volume successfully. Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-4ac2dd15-78d9-4e27-9397-831002ffeb78-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "cinder-quobyte-4ac2dd15-78d9-4e27-9397-831002ffeb78" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-quobyte-4ac2dd15-78d9-4e27-9397-831002ffeb78" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e05b9a-ba85-46d2-b533-968bcb782525]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:39 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:54:39 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:39 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 Jul 03 12:54:39 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Acquiring lock "cinder-be4bb03c-86cb-4ddc-9261-41c0eb14d619-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Lock "cinder-be4bb03c-86cb-4ddc-9261-41c0eb14d619-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Acquiring lock "cinder-quobyte-be4bb03c-86cb-4ddc-9261-41c0eb14d619" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-be4bb03c-86cb-4ddc-9261-41c0eb14d619" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e11a1f-1b99-46ee-a28d-07b72f73f76c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:40 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 Jul 03 12:54:40 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:40 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 0.971s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:40 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:54:40 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:40 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78" returned: 0 in 1.023s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:40 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78 Jul 03 12:54:40 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:41 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619" returned: 0 in 0.904s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:41 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619 Jul 03 12:54:41 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:41 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 1 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.936s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.805s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1146664635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ced0da-4b6d-428b-be5b-6dde4cc56873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bf2899d1c45a491aa667658b4417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:36Z,use_quota=True,user_id='08be85a120b14b428b2b5da5b518e708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Creating volume c8ced0da-4b6d-428b-be5b-6dde4cc56873 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:41 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 1073741824 Jul 03 12:54:41 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-e344fca5-d494-4b16-be50-264f2fd3a10d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5fb01cc-c69f-4701-9014-7938458ed9cd', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:54:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b5d7de04-9dbe-479f-b0bf-0ec62c84f897 req-ad0d47dc-8d67-401d-96b0-cc72a7b79301 tempest-TestShelveInstance-1760542803 None] attachment_update completed successfully. Jul 03 12:54:41 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4ac2dd15-78d9-4e27-9397-831002ffeb78" returned: 0 in 0.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-quobyte-4ac2dd15-78d9-4e27-9397-831002ffeb78" released by "delete_volume" :: held 1.931s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Created reservations ['c1b737e1-5505-4886-9557-a2575e6dcb73', 'c9664fb6-4a44-40b4-883a-f356ca01f366', 'f40cabee-c3d0-4cfb-a854-e7d3c08a7d03', '28d14874-f014-4a61-bc99-4fdfe84c3700'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:41 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:41 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "cinder-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-be4bb03c-86cb-4ddc-9261-41c0eb14d619" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:42 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-be4bb03c-86cb-4ddc-9261-41c0eb14d619" released by "delete_volume" :: held 1.766s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "cinder-quobyte-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-quobyte-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4544e805-327a-455d-b4f5-7b0f5d4349ab]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Created reservations ['17deb7f6-54dd-4bea-8a1f-2458c848a58c', 'ddfea213-0919-4d52-b5c7-e9803d995485', 'c6ba82e3-be1c-44ab-b8fd-1f474c15d1e0', 'e74f3d47-405b-4120-a212-4bdd3a8adc21'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:42 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 Jul 03 12:54:42 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:42 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:42 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Acquiring lock "cinder-8193950f-1a96-4535-8acc-cd91fabd1bea-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Lock "cinder-8193950f-1a96-4535-8acc-cd91fabd1bea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Acquiring lock "cinder-quobyte-8193950f-1a96-4535-8acc-cd91fabd1bea" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-8193950f-1a96-4535-8acc-cd91fabd1bea" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde9fa89-96c8-4308-8689-c806b4b81a5f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:42 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 1073741824" returned: 0 in 1.411s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:43 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 Jul 03 12:54:43 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:43 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:43 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:43 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.238s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Deleted volume successfully. Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6c2ae9a-1ac7-42ff-bb0f-055de4f0d73b tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-4ac2dd15-78d9-4e27-9397-831002ffeb78-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:43 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" returned: 0 in 1.295s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:43 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.147s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Deleted volume successfully. Jul 03 12:54:43 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00 Jul 03 12:54:43 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-debfbb04-4cfd-4a41-9ad7-80f725cb682e tempest-VolumesCloneTest-2011510639 None] Lock "cinder-be4bb03c-86cb-4ddc-9261-41c0eb14d619-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:43 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873" returned: 0 in 0.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13810002-fa95-4bfc-8b0a-3c631753f104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3905d4-9abe-44e5-94ff-80ba39a91716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Volume volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 (c8ced0da-4b6d-428b-be5b-6dde4cc56873): created successfully Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3905d4-9abe-44e5-94ff-80ba39a91716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Flow 'volume_create_manager' (4720b398-185a-4053-8f13-b9a88d824d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1c8883b8-ad2e-4fdd-81cd-8e8101c5db81 tempest-VolumesTransfersTest-1858288910 None] Created volume successfully. Jul 03 12:54:43 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 1.132s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:44 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea Jul 03 12:54:44 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:44 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" returned: 0 in 0.867s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-quobyte-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00" released by "delete_volume" :: held 2.234s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Created reservations ['d30e6ce1-2f22-4117-9599-0fac7abf5117', 'de8dbe7f-f4a6-4da7-bd7f-1a10fdd21d88', '5c12d414-33fb-432e-8e23-6bcd52e6211d', 'e5834b9f-f49e-45a4-8071-50f8d11bc13f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:44 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:44 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:44 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8193950f-1a96-4535-8acc-cd91fabd1bea" returned: 0 in 0.817s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Lock "cinder-quobyte-8193950f-1a96-4535-8acc-cd91fabd1bea" released by "delete_volume" :: held 2.079s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Created reservations ['96ffd5eb-41d8-4198-89c7-659b48c9c357', '9354b73d-f4e1-4835-86f2-eaf46432bb4a', 'c0b0b381-8e8a-4b41-acfe-c27a0d7b9b74', '157b3865-558a-45d9-8acb-ebe88adb5c07'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:45 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:45 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e8ea7918-3192-452b-ac07-aef7ebc7f7aa tempest-VolumesTransfersTest-835091639 None] Transfer volume completed successfully. Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "cinder-565a9d12-ffb9-4369-b817-e0d9098fc0f2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-565a9d12-ffb9-4369-b817-e0d9098fc0f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:45 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.077s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Deleted volume successfully. Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "cinder-quobyte-565a9d12-ffb9-4369-b817-e0d9098fc0f2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8ef63037-ebbc-4ae4-b681-d9bb38484e18 tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-d7ba06b6-7be2-4dcb-949b-ac8daa45aa00-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-quobyte-565a9d12-ffb9-4369-b817-e0d9098fc0f2" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab091e5-3e6b-429b-8de4-eb9a596ee77a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:45 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 Jul 03 12:54:45 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:46 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Deleted volume successfully. Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8990306e-e5b4-4208-b8ba-e83d8b26cd53 tempest-VolumesCloneTest-2011510639 None] Lock "cinder-8193950f-1a96-4535-8acc-cd91fabd1bea-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:46 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2" returned: 0 in 1.039s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Acquiring lock "cinder-c8ced0da-4b6d-428b-be5b-6dde4cc56873-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:46 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2 Jul 03 12:54:46 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-c8ced0da-4b6d-428b-be5b-6dde4cc56873-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Acquiring lock "cinder-quobyte-c8ced0da-4b6d-428b-be5b-6dde4cc56873" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:54:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-quobyte-c8ced0da-4b6d-428b-be5b-6dde4cc56873" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:54:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b358281-4e45-4d0f-b1c4-18925404adbb]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:54:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:47 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 Jul 03 12:54:47 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:48 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-565a9d12-ffb9-4369-b817-e0d9098fc0f2" returned: 0 in 1.469s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-quobyte-565a9d12-ffb9-4369-b817-e0d9098fc0f2" released by "delete_volume" :: held 2.568s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Created reservations ['a109ac77-d10e-4ecd-920f-4a082bb54929', 'e955dfd7-503a-4092-981a-b7a39d6b3a58', '9e08cb84-3ac2-4d7c-bce8-b846f29d8740', '78bc2675-cbfa-47f7-9e85-aede2c18086f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:48 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:48 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:48 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873" returned: 0 in 1.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:49 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873 Jul 03 12:54:49 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:49 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.213s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:49 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Deleted volume successfully. Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c6ada53-80f5-488f-aa0e-5d06cbc46a5a tempest-AttachVolumeTestJSON-1380958095 None] Lock "cinder-565a9d12-ffb9-4369-b817-e0d9098fc0f2-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:50 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c8ced0da-4b6d-428b-be5b-6dde4cc56873" returned: 0 in 1.446s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-quobyte-c8ced0da-4b6d-428b-be5b-6dde4cc56873" released by "delete_volume" :: held 3.251s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Created reservations ['f6da6e7d-d9d8-4bac-9a05-e44d9df77edb', '23e36715-ea15-491e-90cc-5a99eccd2234', '34d78721-956c-406d-bc87-0fade02f1c67', 'c4a6c7fd-4989-456c-b9f9-bd6cb99bf1be'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:50 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:54:50 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:51 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.277s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:52 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:54:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Deleted volume successfully. Jul 03 12:54:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27a90a1-6b4e-4856-b3a0-f51a4ec61f53 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-c8ced0da-4b6d-428b-be5b-6dde4cc56873-delete_volume" released by "delete_volume" :: held 5.107s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Flow 'volume_create_manager' (9b68056d-f8c8-44ad-b937-6ce48bbb2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4771493c-f80b-43a2-ab18-46cc412bfaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4771493c-f80b-43a2-ab18-46cc412bfaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-671239085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59effbb0762f44b7acc346b5644bae0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:53Z,use_quota=True,user_id='7420e69b2c3d48088a489692be86c763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c83e0dc-60b6-435f-a5e7-536a7f027248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c83e0dc-60b6-435f-a5e7-536a7f027248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b836bd-42bd-4c84-a48f-05b291b3d992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b836bd-42bd-4c84-a48f-05b291b3d992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8', 'volume_name': 'volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc746f4-241d-40f6-a4bf-c91bd6647c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc746f4-241d-40f6-a4bf-c91bd6647c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f962d4c6-e5be-4468-88b0-14431d197e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Volume 7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8', 'volume_size': 1} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-671239085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59effbb0762f44b7acc346b5644bae0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:53Z,use_quota=True,user_id='7420e69b2c3d48088a489692be86c763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Creating volume 7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:53 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 1073741824 Jul 03 12:54:53 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Flow 'volume_create_manager' (7f9e588f-6395-4b8f-b731-71fb87bdf936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640e4f06-08cb-4bdb-82c9-1fb81e96788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640e4f06-08cb-4bdb-82c9-1fb81e96788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1584710190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b77779-d3b5-43b3-8eab-364fdead13a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bf2899d1c45a491aa667658b4417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:54Z,use_quota=True,user_id='08be85a120b14b428b2b5da5b518e708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0d6238-b49e-40a3-b100-da053594b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0d6238-b49e-40a3-b100-da053594b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b83d53-f4c2-45f7-9753-fb61f7af93ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b83d53-f4c2-45f7-9753-fb61f7af93ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b77779-d3b5-43b3-8eab-364fdead13a1', 'volume_name': 'volume-86b77779-d3b5-43b3-8eab-364fdead13a1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8f13f2-fb83-47e6-b31f-22ff4b561b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8f13f2-fb83-47e6-b31f-22ff4b561b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501cd431-3f9d-475d-b890-99cee53d1024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Volume 86b77779-d3b5-43b3-8eab-364fdead13a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b77779-d3b5-43b3-8eab-364fdead13a1', 'volume_size': 1} Jul 03 12:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:55 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 1073741824" returned: 0 in 1.722s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:55 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 Jul 03 12:54:55 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:56 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8" returned: 0 in 1.045s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] <== create_volume: return (2851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.676s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1584710190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b77779-d3b5-43b3-8eab-364fdead13a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bf2899d1c45a491aa667658b4417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:54Z,use_quota=True,user_id='08be85a120b14b428b2b5da5b518e708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Creating volume 86b77779-d3b5-43b3-8eab-364fdead13a1 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:56 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f962d4c6-e5be-4468-88b0-14431d197e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:56 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 1073741824 Jul 03 12:54:56 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753935f1-3a7b-4f39-a6b6-fcab7ed72a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Volume volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 (7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8): created successfully Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753935f1-3a7b-4f39-a6b6-fcab7ed72a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Flow 'volume_create_manager' (9b68056d-f8c8-44ad-b937-6ce48bbb2747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-812a391c-3335-4916-b0a1-f47c5855f1b5 tempest-VolumesListTestJSON-1447060592 None] Created volume successfully. Jul 03 12:54:58 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 1073741824" returned: 0 in 1.911s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:58 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 Jul 03 12:54:58 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Flow 'volume_create_manager' (7f371af7-5e1e-48d2-8680-38576623fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bb6471-ead9-4214-a621-268ad992a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bb6471-ead9-4214-a621-268ad992a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-208391487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99946019-9e4a-47c6-88f9-76d977ae49c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59effbb0762f44b7acc346b5644bae0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:59Z,use_quota=True,user_id='7420e69b2c3d48088a489692be86c763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f784b71-a864-435d-a5c9-f0b52d9cc57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f784b71-a864-435d-a5c9-f0b52d9cc57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad82398-5fab-4bdb-bff5-5f3c91dcb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad82398-5fab-4bdb-bff5-5f3c91dcb50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99946019-9e4a-47c6-88f9-76d977ae49c8', 'volume_name': 'volume-99946019-9e4a-47c6-88f9-76d977ae49c8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded7cda0-5e88-4c3d-816c-6289d5561a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded7cda0-5e88-4c3d-816c-6289d5561a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e921493-8e2c-467e-bfea-2523c84623e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Volume 99946019-9e4a-47c6-88f9-76d977ae49c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99946019-9e4a-47c6-88f9-76d977ae49c8', 'volume_size': 1} Jul 03 12:54:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:59 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1" returned: 0 in 1.063s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] <== create_volume: return (3079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.092s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-208391487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99946019-9e4a-47c6-88f9-76d977ae49c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59effbb0762f44b7acc346b5644bae0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:59Z,use_quota=True,user_id='7420e69b2c3d48088a489692be86c763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Creating volume 99946019-9e4a-47c6-88f9-76d977ae49c8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:54:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:54:59 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 1073741824 Jul 03 12:54:59 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501cd431-3f9d-475d-b890-99cee53d1024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b77779-d3b5-43b3-8eab-364fdead13a1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec74b15a-82f9-4fce-9e41-b875423ea0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:54:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Volume volume-86b77779-d3b5-43b3-8eab-364fdead13a1 (86b77779-d3b5-43b3-8eab-364fdead13a1): created successfully Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec74b15a-82f9-4fce-9e41-b875423ea0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Flow 'volume_create_manager' (7f9e588f-6395-4b8f-b731-71fb87bdf936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:54:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-65c41e59-cede-477d-83f2-6a6948753168 tempest-VolumesTransfersTest-1858288910 None] Created volume successfully. Jul 03 12:55:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Acquiring lock "cinder-86b77779-d3b5-43b3-8eab-364fdead13a1-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-86b77779-d3b5-43b3-8eab-364fdead13a1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Acquiring lock "cinder-quobyte-86b77779-d3b5-43b3-8eab-364fdead13a1" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-quobyte-86b77779-d3b5-43b3-8eab-364fdead13a1" acquired by "delete_volume" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad9af66-5ae4-4d84-9d48-f35943a0f02f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:01 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 Jul 03 12:55:01 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:01 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 1073741824" returned: 0 in 1.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:01 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 Jul 03 12:55:01 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:01 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:02 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:02 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1" returned: 0 in 1.463s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:02 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1 Jul 03 12:55:02 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:02 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8" returned: 0 in 1.163s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] <== create_volume: return (2985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e921493-8e2c-467e-bfea-2523c84623e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99946019-9e4a-47c6-88f9-76d977ae49c8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dd3997-383b-40a5-aeaa-976747bd867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Volume volume-99946019-9e4a-47c6-88f9-76d977ae49c8 (99946019-9e4a-47c6-88f9-76d977ae49c8): created successfully Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dd3997-383b-40a5-aeaa-976747bd867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Flow 'volume_create_manager' (7f371af7-5e1e-48d2-8680-38576623fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cecc80da-a6b4-4b63-97a6-4dc2cee1065f tempest-VolumesListTestJSON-1447060592 None] Created volume successfully. Jul 03 12:55:03 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-86b77779-d3b5-43b3-8eab-364fdead13a1" returned: 0 in 1.087s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-quobyte-86b77779-d3b5-43b3-8eab-364fdead13a1" released by "delete_volume" :: held 2.641s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:03 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.468s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Created reservations ['f77915a9-43c1-41d1-ae7b-817767de6a2c', 'a8272379-bf3e-44cc-9fba-97b3cd7625c1', '043c1665-9e04-419d-965c-5dc2bd08d62a', 'dae587cc-428b-41df-946d-7c49ce3c30d0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:03 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:03 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Flow 'volume_create_manager' (b3fa768e-74bf-4037-9ab2-62ef1f3f6b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8eae138-43e8-476b-a600-f4e3c23a8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8eae138-43e8-476b-a600-f4e3c23a8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-524784309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70e080e-8903-48e2-8f15-8ef384939a7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59effbb0762f44b7acc346b5644bae0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:04Z,use_quota=True,user_id='7420e69b2c3d48088a489692be86c763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff4e060-92a3-4bd5-9cfe-601ec8f2814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff4e060-92a3-4bd5-9cfe-601ec8f2814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3fdb0-2aad-45d2-a177-95afd04c7684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3fdb0-2aad-45d2-a177-95afd04c7684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70e080e-8903-48e2-8f15-8ef384939a7b', 'volume_name': 'volume-f70e080e-8903-48e2-8f15-8ef384939a7b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed7acf6-cb75-43c5-a12b-2c7d3b225ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed7acf6-cb75-43c5-a12b-2c7d3b225ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee16d4f-cfe4-4e56-9327-10780c2fde12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Volume f70e080e-8903-48e2-8f15-8ef384939a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70e080e-8903-48e2-8f15-8ef384939a7b', 'volume_size': 1} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-524784309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70e080e-8903-48e2-8f15-8ef384939a7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='59effbb0762f44b7acc346b5644bae0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:04Z,use_quota=True,user_id='7420e69b2c3d48088a489692be86c763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Creating volume f70e080e-8903-48e2-8f15-8ef384939a7b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:55:04 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:04 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b 1073741824 Jul 03 12:55:04 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Flow 'volume_create_manager' (aa2e8688-5ece-4558-94c8-9c612578e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada3a60-a117-4e34-852f-8b54cce18c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada3a60-a117-4e34-852f-8b54cce18c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1362815536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2ceb4d-e832-427b-9475-9dcf7eeabe11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec947d517764d31b7665a9273a82164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:05Z,use_quota=True,user_id='b8cffb894eb94082888d5dba8a0b3d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef2d3d3-98b6-4740-a602-9956ee4ac71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef2d3d3-98b6-4740-a602-9956ee4ac71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:05 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca13c9-bdac-4d53-b422-5138c1db3b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca13c9-bdac-4d53-b422-5138c1db3b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2ceb4d-e832-427b-9475-9dcf7eeabe11', 'volume_name': 'volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2364dba-d817-4264-92ec-347d09be1a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2364dba-d817-4264-92ec-347d09be1a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72710e46-416e-4554-b05c-e25af4473836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Volume 0d2ceb4d-e832-427b-9475-9dcf7eeabe11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11', 'volume_size': 1} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.646s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Deleted volume successfully. Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f5ad20c2-178e-4113-ab9f-36a5050c9be0 tempest-VolumesTransfersTest-1228497265 None] Lock "cinder-86b77779-d3b5-43b3-8eab-364fdead13a1-delete_volume" released by "delete_volume" :: held 4.729s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:05 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b 1073741824" returned: 0 in 1.352s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:05 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b Jul 03 12:55:05 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:06 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b" returned: 0 in 0.846s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1362815536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2ceb4d-e832-427b-9475-9dcf7eeabe11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec947d517764d31b7665a9273a82164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:05Z,use_quota=True,user_id='b8cffb894eb94082888d5dba8a0b3d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Creating volume 0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:55:06 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:06 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 1073741824 Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee16d4f-cfe4-4e56-9327-10780c2fde12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70e080e-8903-48e2-8f15-8ef384939a7b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:06 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da2ab4c-b6ad-45a6-8fe0-8ff89eea6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Volume volume-f70e080e-8903-48e2-8f15-8ef384939a7b (f70e080e-8903-48e2-8f15-8ef384939a7b): created successfully Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da2ab4c-b6ad-45a6-8fe0-8ff89eea6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Flow 'volume_create_manager' (b3fa768e-74bf-4037-9ab2-62ef1f3f6b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3b7f0ed1-2db2-438c-9821-68dc3f6f8e77 tempest-VolumesListTestJSON-1447060592 None] Created volume successfully. Jul 03 12:55:08 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 1073741824" returned: 0 in 1.365s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:08 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 Jul 03 12:55:08 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:09 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" returned: 0 in 1.073s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] <== create_volume: return (2513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72710e46-416e-4554-b05c-e25af4473836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d23bf2-1da4-4f79-8ed7-5b1703a5e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Volume volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 (0d2ceb4d-e832-427b-9475-9dcf7eeabe11): created successfully Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d23bf2-1da4-4f79-8ed7-5b1703a5e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Flow 'volume_create_manager' (aa2e8688-5ece-4558-94c8-9c612578e807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-0c409578-acf2-45f7-beae-c4ed5dc2e79a req-a59d8637-b3ff-4cb2-8064-4e24ceb4bf69 tempest-VolumesSnapshotsTestJSON-1049653517 None] Created volume successfully. Jul 03 12:55:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Creating offline snapshot 06faaaee-61e8-4c62-9f8a-e93d225379d9 of volume 0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:55:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[98030b8a-4149-441f-ac7f-e9b6eb17613b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:10 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 Jul 03 12:55:10 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "cinder-f70e080e-8903-48e2-8f15-8ef384939a7b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-f70e080e-8903-48e2-8f15-8ef384939a7b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "cinder-quobyte-f70e080e-8903-48e2-8f15-8ef384939a7b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-quobyte-f70e080e-8903-48e2-8f15-8ef384939a7b" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7826c5-b26e-46b1-831a-6c0da599deaf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:11 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b Jul 03 12:55:11 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:11 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" returned: 0 in 1.251s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:11 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 1G Jul 03 12:55:11 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:12 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b" returned: 0 in 0.969s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:12 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b Jul 03 12:55:12 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:12 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 1G" returned: 0 in 1.016s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:12 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 Jul 03 12:55:12 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:12 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f70e080e-8903-48e2-8f15-8ef384939a7b" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-quobyte-f70e080e-8903-48e2-8f15-8ef384939a7b" released by "delete_volume" :: held 1.835s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Created reservations ['9d1751cc-1eb3-4c58-99b0-41b810dac898', '38a1eb44-969f-47b2-895e-d8e4b13ce007', '2c7aaa61-f5ed-4111-987a-3eddf13e2430', '984c7b5c-43bc-48f3-9e0a-99ea2ffcbb60'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:13 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:13 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:13 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9" returned: 0 in 0.845s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 is being set with open permissions: ugo+rw Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:13 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 Jul 03 12:55:13 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "cinder-99946019-9e4a-47c6-88f9-76d977ae49c8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-99946019-9e4a-47c6-88f9-76d977ae49c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "cinder-quobyte-99946019-9e4a-47c6-88f9-76d977ae49c8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-quobyte-99946019-9e4a-47c6-88f9-76d977ae49c8" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[247112cf-4583-4106-b82c-1ac38c26fc5a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:13 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 Jul 03 12:55:13 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:14 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Deleted volume successfully. Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c675b565-56bb-49ed-b951-52184ab8d673 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-f70e080e-8903-48e2-8f15-8ef384939a7b-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:14 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:14 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info Jul 03 12:55:14 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:14 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8" returned: 0 in 0.977s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:14 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8 Jul 03 12:55:14 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Flow 'volume_create_manager' (ad8f4ed5-cdde-4229-91b6-2c60cfac407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80400c9-5b28-4d76-b655-8a08bba4fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80400c9-5b28-4d76-b655-8a08bba4fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1194851083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bc74b3-d218-4b39-86ce-52e96a673708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c87d9b5f66404094496502b9a8cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:15Z,use_quota=True,user_id='319ed3b7c9df45daa029e0c8931f7b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080491d5-ed56-4073-8d60-0ae1eaacae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080491d5-ed56-4073-8d60-0ae1eaacae0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faf5987-5ac2-427b-9c83-5cd9e4dbf157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faf5987-5ac2-427b-9c83-5cd9e4dbf157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4bc74b3-d218-4b39-86ce-52e96a673708', 'volume_name': 'volume-c4bc74b3-d218-4b39-86ce-52e96a673708', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9da23c-ba5a-4f2d-93b8-d6b75528f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9da23c-ba5a-4f2d-93b8-d6b75528f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba14554d-f8bb-4aed-b894-f3d4e9d82fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Volume c4bc74b3-d218-4b39-86ce-52e96a673708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4bc74b3-d218-4b39-86ce-52e96a673708', 'volume_size': 1} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:15 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:15 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info is being set with open permissions: ugo+rw Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:15 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info Jul 03 12:55:15 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:15 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-99946019-9e4a-47c6-88f9-76d977ae49c8" returned: 0 in 0.844s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-quobyte-99946019-9e4a-47c6-88f9-76d977ae49c8" released by "delete_volume" :: held 1.886s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Created reservations ['44274c38-dc4d-47db-abe8-11ca5f5e5166', '71f692ae-6324-45aa-831b-3383a017c0cc', '1db73e34-a90a-43dc-967d-5283580783e0', 'bb3383a9-295a-40a3-980f-abc99e53dac6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:15 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:15 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:15 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.info" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.782s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1194851083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bc74b3-d218-4b39-86ce-52e96a673708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c87d9b5f66404094496502b9a8cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:15Z,use_quota=True,user_id='319ed3b7c9df45daa029e0c8931f7b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Creating volume c4bc74b3-d218-4b39-86ce-52e96a673708 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:55:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:15 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 1073741824 Jul 03 12:55:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "cinder-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:15 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-79800ade-ede8-4882-8381-9dabe303adb8 req-90aedf62-3275-45fc-b8ff-d528db38f8b6 tempest-VolumesSnapshotsTestJSON-1049653517 None] Create snapshot completed successfully Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "cinder-quobyte-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-quobyte-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c630a6-4408-4edf-8201-68b8696a9789]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:16 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 Jul 03 12:55:16 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "cinder-06faaaee-61e8-4c62-9f8a-e93d225379d9-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-06faaaee-61e8-4c62-9f8a-e93d225379d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "cinder-quobyte-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-quobyte-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "cinder-quobyte-06faaaee-61e8-4c62-9f8a-e93d225379d9" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:16 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-quobyte-06faaaee-61e8-4c62-9f8a-e93d225379d9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Deleting offline snapshot 06faaaee-61e8-4c62-9f8a-e93d225379d9 of volume 0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] snapshot_file for this snap is: volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.168s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Deleted volume successfully. Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf22e83-386a-4e17-89a9-195c352d1868]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2635db39-224a-4dff-9b19-ea47c0a55727 tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-99946019-9e4a-47c6-88f9-76d977ae49c8-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:16 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 Jul 03 12:55:16 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:17 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 1073741824" returned: 0 in 1.401s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:17 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8" returned: 0 in 1.214s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:17 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8 Jul 03 12:55:17 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:17 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 Jul 03 12:55:17 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:17 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9" returned: 0 in 1.007s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb366d-036e-45e5-9fa2-a72e92cffc5c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:18 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 Jul 03 12:55:18 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:18 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-quobyte-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8" released by "delete_volume" :: held 2.103s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Created reservations ['c9610d71-a12b-40d0-ae5f-1abf87fd96eb', '855160d4-3040-40ab-a81d-5d3dbe98c5f8', '694c149f-1f8b-49c2-9445-1679de370947', 'b4c7aaf5-2162-49d3-869b-4dd84cf92278'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:18 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba14554d-f8bb-4aed-b894-f3d4e9d82fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4bc74b3-d218-4b39-86ce-52e96a673708', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c788ed88-6650-4147-afd5-720881a6f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Volume volume-c4bc74b3-d218-4b39-86ce-52e96a673708 (c4bc74b3-d218-4b39-86ce-52e96a673708): created successfully Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c788ed88-6650-4147-afd5-720881a6f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Flow 'volume_create_manager' (ad8f4ed5-cdde-4229-91b6-2c60cfac407b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-20b8a095-d7e6-4855-8fa1-c8d034904c09 tempest-VolumesTransfersV355Test-53431857 None] Created volume successfully. Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:18 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:18 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:18 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:18 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 Jul 03 12:55:18 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:19 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.969s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:19 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Deleted volume successfully. Jul 03 12:55:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dfaf029b-45e8-4c0c-815f-fd7784b896fe tempest-VolumesListTestJSON-1447060592 None] Lock "cinder-7ce1aecf-ac0c-4eb2-a5d5-dea55602dcb8-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-887158ef-e3bd-40cd-a219-3ea184ce510e tempest-VolumesTransfersV355Test-1901913804 None] Transfer volume completed successfully. Jul 03 12:55:20 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9" returned: 0 in 1.476s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:20 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9 Jul 03 12:55:20 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:21 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11.06faaaee-61e8-4c62-9f8a-e93d225379d9" returned: 0 in 0.800s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-quobyte-06faaaee-61e8-4c62-9f8a-e93d225379d9" released by "_delete_snapshot" :: held 4.579s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-quobyte-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" released by "delete_snapshot" :: held 4.637s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.quota [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Created reservations ['40f66a11-2e21-4a44-bb75-68636e1f523f', 'ffd1e336-a9a6-49a9-8fb1-b42aa7ad1303', '416ed4ce-f428-495b-a7d9-d355d1a5e553', '83e56828-521a-4526-ba4b-d44835bb5e2c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Delete snapshot completed successfully. Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-24f688ae-6be7-4579-8317-047aed44707c req-a1ec4810-23ab-4f1f-8e2f-d8992a984bd0 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-06faaaee-61e8-4c62-9f8a-e93d225379d9-delete_snapshot" released by "delete_snapshot" :: held 4.934s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Acquiring lock "cinder-c4bc74b3-d218-4b39-86ce-52e96a673708-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-c4bc74b3-d218-4b39-86ce-52e96a673708-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Acquiring lock "cinder-quobyte-c4bc74b3-d218-4b39-86ce-52e96a673708" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-quobyte-c4bc74b3-d218-4b39-86ce-52e96a673708" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[903e7efc-1423-4bef-be31-a3019d86145e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:22 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 Jul 03 12:55:22 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "cinder-0d2ceb4d-e832-427b-9475-9dcf7eeabe11-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-0d2ceb4d-e832-427b-9475-9dcf7eeabe11-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "cinder-quobyte-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-quobyte-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b536f5-2bf2-46de-963e-f3d826dfaa07]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:22 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 Jul 03 12:55:22 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:23 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708" returned: 0 in 1.115s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:23 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708 Jul 03 12:55:23 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:23 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" returned: 0 in 1.073s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:23 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11 Jul 03 12:55:23 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:24 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c4bc74b3-d218-4b39-86ce-52e96a673708" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-quobyte-c4bc74b3-d218-4b39-86ce-52e96a673708" released by "delete_volume" :: held 2.099s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Created reservations ['cbdcd2bd-6d3b-4fa6-bd46-7c20bb8b88aa', '83d54aa6-0726-48c5-a2c9-5bc380c2f3bd', '3dfd1ad0-8ad9-4f2a-8e9d-0015f3326eb8', '12c56a2c-b7f1-45f4-9395-2fe2872d2c61'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:24 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:24 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:24 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" returned: 0 in 1.253s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-quobyte-0d2ceb4d-e832-427b-9475-9dcf7eeabe11" released by "delete_volume" :: held 2.413s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.quota [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Created reservations ['e2da3a20-f403-4122-bd31-f3d921b7ecdd', '4862d3b6-4e0a-4018-b409-cb0b84928b29', 'c4f9a346-4b1c-40cb-ad14-1b391edc5c2b', 'c60d8d05-4c7d-4556-bd88-32bb8144eb76'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:25 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:25 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:25 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.287s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:25 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Deleted volume successfully. Jul 03 12:55:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afbe42ac-2164-4eb8-994a-c73200bb5beb tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-c4bc74b3-d218-4b39-86ce-52e96a673708-delete_volume" released by "delete_volume" :: held 3.806s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:26 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.317s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.manager [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ef8aefed-2959-4c77-a851-d1730bd2d44e req-6efa54c6-09c6-47e3-9126-5cd3f239ff82 tempest-TestShelveInstance-1760542803 None] Terminate volume connection completed successfully. Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ef8aefed-2959-4c77-a851-d1730bd2d44e req-6efa54c6-09c6-47e3-9126-5cd3f239ff82 tempest-TestShelveInstance-1760542803 None] Deleting attachment b5fb01cc-c69f-4701-9014-7938458ed9cd. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:55:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Deleted volume successfully. Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-a782508f-cc68-4497-a9b4-5ce8864a8f35 req-7c0998f6-ee93-4464-8985-7a6b6f072952 tempest-VolumesSnapshotsTestJSON-1049653517 None] Lock "cinder-0d2ceb4d-e832-427b-9475-9dcf7eeabe11-delete_volume" released by "delete_volume" :: held 4.057s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Flow 'volume_create_manager' (ebef94b1-63a8-43cc-aa50-6cb7cd3960c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b5d76a-ad68-4e68-ad87-406cac02256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b5d76a-ad68-4e68-ad87-406cac02256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1522933431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265cc4ea-d7a6-4f08-b8de-3979285c86ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c87d9b5f66404094496502b9a8cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:26Z,use_quota=True,user_id='319ed3b7c9df45daa029e0c8931f7b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb4ba7e-63a2-43c3-824a-7ec738a20ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb4ba7e-63a2-43c3-824a-7ec738a20ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab237cbf-88f8-48e4-88f2-c1d64e644059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab237cbf-88f8-48e4-88f2-c1d64e644059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265cc4ea-d7a6-4f08-b8de-3979285c86ff', 'volume_name': 'volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c8694d-2caf-4ebb-895d-1ee77728732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c8694d-2caf-4ebb-895d-1ee77728732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de631530-1e53-4f58-9fc2-3a4d3d2b3766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Volume 265cc4ea-d7a6-4f08-b8de-3979285c86ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff', 'volume_size': 1} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1522933431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265cc4ea-d7a6-4f08-b8de-3979285c86ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c87d9b5f66404094496502b9a8cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:26Z,use_quota=True,user_id='319ed3b7c9df45daa029e0c8931f7b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Creating volume 265cc4ea-d7a6-4f08-b8de-3979285c86ff {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:55:26 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:26 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff 1073741824 Jul 03 12:55:26 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:27 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff 1073741824" returned: 0 in 1.261s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:27 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff Jul 03 12:55:27 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:28 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de631530-1e53-4f58-9fc2-3a4d3d2b3766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872962ad-c79d-4c2a-acf2-b96a9367561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Volume volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff (265cc4ea-d7a6-4f08-b8de-3979285c86ff): created successfully Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872962ad-c79d-4c2a-acf2-b96a9367561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Flow 'volume_create_manager' (ebef94b1-63a8-43cc-aa50-6cb7cd3960c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9f85ebb7-5b65-4376-9130-ee5cfc7a452d tempest-VolumesTransfersV355Test-53431857 None] Created volume successfully. Jul 03 12:55:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Acquiring lock "cinder-265cc4ea-d7a6-4f08-b8de-3979285c86ff-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-265cc4ea-d7a6-4f08-b8de-3979285c86ff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Acquiring lock "cinder-quobyte-265cc4ea-d7a6-4f08-b8de-3979285c86ff" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:55:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-quobyte-265cc4ea-d7a6-4f08-b8de-3979285c86ff" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:55:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[af390df4-f4b8-456d-bd1f-c193095ae58b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:30 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff Jul 03 12:55:30 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:31 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff" returned: 0 in 1.499s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:31 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff Jul 03 12:55:31 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eeb7231d-b22a-43d7-90ce-36018b7a2af3 tempest-GroupsV320Test-1944458175 None] Group tempest-GroupsV320Test-Group-1494266513: creating Jul 03 12:55:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eeb7231d-b22a-43d7-90ce-36018b7a2af3 tempest-GroupsV320Test-1944458175 None] Group tempest-GroupsV320Test-Group-1494266513: created successfully Jul 03 12:55:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eeb7231d-b22a-43d7-90ce-36018b7a2af3 tempest-GroupsV320Test-1944458175 None] Create group completed successfully. Jul 03 12:55:33 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-265cc4ea-d7a6-4f08-b8de-3979285c86ff" returned: 0 in 1.334s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-quobyte-265cc4ea-d7a6-4f08-b8de-3979285c86ff" released by "delete_volume" :: held 2.984s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Created reservations ['9a90edf1-41e0-440b-a059-df066c9f991f', 'f062ac8f-a43b-4645-b7c7-aa4869b05994', '6dc96779-fe22-4519-bef5-3c75f45e86a0', 'efbb88a8-e4f6-43ff-b08f-9f73f7e9e4e4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:33 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:33 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Created reservations ['7b06cda9-7fa3-4ada-ab82-605c736dec08'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:34 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:55:34 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:34 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.370s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Deleted volume successfully. Jul 03 12:55:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e5ac4088-f7ef-48cc-a5cc-ebebe5f8fbab tempest-VolumesTransfersV355Test-695398328 None] Lock "cinder-265cc4ea-d7a6-4f08-b8de-3979285c86ff-delete_volume" released by "delete_volume" :: held 4.767s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c5e19-f2d3-4a28-be7f-4b8106b39463]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:35 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:55:35 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:35 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.090s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:55:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fe5e9bf1-57fa-4774-bbaf-03141353d071 tempest-GroupsV320Test-1944458175 None] Delete group completed successfully. Jul 03 12:55:36 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 1.145s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:36 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:55:36 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:37 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 1 in 0.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.130s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-e344fca5-d494-4b16-be50-264f2fd3a10d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f06ba65-ff84-4e96-b554-df57af986eed', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:55:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-9b7f7433-e37a-4fa1-ac6d-ea0e2464c4ef req-5ba7d69a-eaee-489d-ae20-f7990dae22c3 tempest-TestShelveInstance-1760542803 None] attachment_update completed successfully. Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=113,cinder:UPDATE=155,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=133,cinder:DELETE=15,cinder:SELECT=106,cinder:INSERT=37 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Flow 'volume_create_manager' (ec33d4e6-c641-407b-b6d5-c74729572051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2de50b2-deb1-4934-a3c6-7dff319f6ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2de50b2-deb1-4934-a3c6-7dff319f6ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-295392760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433509b5b8954fef95fcd636f0937968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:44Z,use_quota=True,user_id='54fa231d673345298f0572228fdec633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e298e4b-6744-4b89-9ac4-dd3ccd26d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e298e4b-6744-4b89-9ac4-dd3ccd26d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8841a-d51b-45f7-9648-ccea836d5fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:44 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8841a-d51b-45f7-9648-ccea836d5fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94', 'volume_name': 'volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7eb401-17df-4325-8682-19c195477576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7eb401-17df-4325-8682-19c195477576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e063be84-cf94-462d-ae4a-a3c1bd017ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Volume 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Trying to clone 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 12:55:45 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Image download 20.69 MB at 20.69 MB/s Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2d608-3f76-465f-9c1d-c78dc0b5ca9d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:45 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD Jul 03 12:55:45 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:46 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD" returned: 0 in 1.215s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:46 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b is fetched for user 54fa231d673345298f0572228fdec633. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 12:55:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa8976-b996-4e7c-9ac6-727f17cfb2aa]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:47 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD Jul 03 12:55:47 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:48 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD" returned: 0 in 1.163s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-295392760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433509b5b8954fef95fcd636f0937968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:44Z,use_quota=True,user_id='54fa231d673345298f0572228fdec633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Creating volume 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:55:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:55:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:48 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 1073741824 Jul 03 12:55:48 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:49 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 1073741824" returned: 0 in 1.344s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:49 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:55:49 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:50 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 0 in 1.123s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:55:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:50 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Attempting download of 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 12:55:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[40493e79-abbf-42e7-ac08-00a54ce7fc24]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:51 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su Jul 03 12:55:51 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:52 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su" returned: 0 in 1.528s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:52 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su Jul 03 12:55:52 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:54 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su" returned: 1 in 1.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_10sml3su' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:55:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf464bf4-4675-4972-9595-8d402420838b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:55:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:54 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD Jul 03 12:55:54 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:55 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD" returned: 0 in 1.364s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:55 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] 8afb0fcf-aee7-4200-b86c-2c05ba162c4b was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 12:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:55 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:55:55 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Flow 'volume_create_manager' (f792a778-a809-4542-b06e-a14c85c587be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840c1592-d588-4438-badc-b764090a1849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840c1592-d588-4438-badc-b764090a1849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-826133131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71701af7-94a9-4304-81d9-96b7f9cdaee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839f716f7b174ab786afb8eda591036c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:59Z,use_quota=True,user_id='e1ad7cce5abe4661856872c596036b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5189f9-d092-4353-959a-3495a75f6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5189f9-d092-4353-959a-3495a75f6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a42d5ac-8d84-4b1d-a4b6-2f899edf7a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a42d5ac-8d84-4b1d-a4b6-2f899edf7a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71701af7-94a9-4304-81d9-96b7f9cdaee6', 'volume_name': 'volume-71701af7-94a9-4304-81d9-96b7f9cdaee6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f60a72b-7be6-4be5-9e6d-9a624b7e51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f60a72b-7be6-4be5-9e6d-9a624b7e51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1e37ab-0208-4025-95b1-7b7dcc44751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:55:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Volume 71701af7-94a9-4304-81d9-96b7f9cdaee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71701af7-94a9-4304-81d9-96b7f9cdaee6', 'volume_size': 1} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-826133131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71701af7-94a9-4304-81d9-96b7f9cdaee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839f716f7b174ab786afb8eda591036c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:59Z,use_quota=True,user_id='e1ad7cce5abe4661856872c596036b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Creating volume 71701af7-94a9-4304-81d9-96b7f9cdaee6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:55:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:59 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 1073741824 Jul 03 12:55:59 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:59 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 0 in 3.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8afb0fcf-aee7-4200-b86c-2c05ba162c4b_pyj6oyscdevstack@QuobyteHD, size 112.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:55:59 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Converted 112.00 MB image at 30.24 MB/s Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:55:59 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 1G Jul 03 12:55:59 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Flow 'volume_create_manager' (17e54a6f-7d6b-47c1-969a-a0db91626188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:55:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5e029-0aac-4b83-8193-07b63f113287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5e029-0aac-4b83-8193-07b63f113287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-678148699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8ab17e-7592-443e-867a-00939c497f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839f716f7b174ab786afb8eda591036c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:00Z,use_quota=True,user_id='e1ad7cce5abe4661856872c596036b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055af351-6d79-4532-8c86-0d4ca3df6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055af351-6d79-4532-8c86-0d4ca3df6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c236cbdf-cb91-4f51-8703-09be1d4f6949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c236cbdf-cb91-4f51-8703-09be1d4f6949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8ab17e-7592-443e-867a-00939c497f30', 'volume_name': 'volume-0f8ab17e-7592-443e-867a-00939c497f30', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb62372-d7b5-4c4d-820d-b6e2bac078e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb62372-d7b5-4c4d-820d-b6e2bac078e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caba2f31-ad31-4231-9007-3290669c5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Volume 0f8ab17e-7592-443e-867a-00939c497f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8ab17e-7592-443e-867a-00939c497f30', 'volume_size': 1} Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:00 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 1G" returned: 0 in 1.547s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482810b-b35a-4489-82da-689e3f2d39e4]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:01 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:01 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:01 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 1073741824" returned: 0 in 2.077s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:01 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 Jul 03 12:56:01 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:02 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:56:02 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:02 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6" returned: 0 in 1.246s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] <== create_volume: return (3453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.458s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.600s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-678148699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8ab17e-7592-443e-867a-00939c497f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839f716f7b174ab786afb8eda591036c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:00Z,use_quota=True,user_id='e1ad7cce5abe4661856872c596036b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Creating volume 0f8ab17e-7592-443e-867a-00939c497f30 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:56:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1e37ab-0208-4025-95b1-7b7dcc44751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71701af7-94a9-4304-81d9-96b7f9cdaee6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:02 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 1073741824 Jul 03 12:56:02 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d13e0b-e7a1-4695-b140-66c08fcf37d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Volume volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 (71701af7-94a9-4304-81d9-96b7f9cdaee6): created successfully Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d13e0b-e7a1-4695-b140-66c08fcf37d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Flow 'volume_create_manager' (f792a778-a809-4542-b06e-a14c85c587be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f616a2ce-7dba-4ccb-abc0-92ed4451530b tempest-TestServerVolumeAttachmentScenario-1468155267 None] Created volume successfully. Jul 03 12:56:03 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 0 in 2.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:03 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:03 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:03 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.693s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:56:04 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 1073741824" returned: 0 in 2.000s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:04 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 Jul 03 12:56:04 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:04 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 1 in 1.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Downloaded image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b ((None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}])) to volume 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Temporary image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b for user 54fa231d673345298f0572228fdec633 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Marking volume 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Copying metadata from image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b to 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 12:56:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Creating volume glance metadata for volume 98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 backed by image 8afb0fcf-aee7-4200-b86c-2c05ba162c4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e063be84-cf94-462d-ae4a-a3c1bd017ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94', 'volume_size': 1, 'image_id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '863068b51aac4380a5d514e32f5913bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8afb0fcf-aee7-4200-b86c-2c05ba162c4b', 'created_at': datetime.datetime(2026, 7, 3, 10, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8afb0fcf-aee7-4200-b86c-2c05ba162c4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ae6b75-548f-4914-82d0-f0fd3df1a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Volume volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 (98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94): created successfully Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ae6b75-548f-4914-82d0-f0fd3df1a68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Flow 'volume_create_manager' (ec33d4e6-c641-407b-b6d5-c74729572051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3e5ba578-f743-4ec3-a740-8fb4f20f7d7b tempest-VolumesExtendTest-1182119689 None] Created volume successfully. Jul 03 12:56:05 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30" returned: 0 in 1.195s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] <== create_volume: return (3285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.293s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caba2f31-ad31-4231-9007-3290669c5446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8ab17e-7592-443e-867a-00939c497f30', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7090fd-3f96-4a40-9b9e-dec08d221dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Volume volume-0f8ab17e-7592-443e-867a-00939c497f30 (0f8ab17e-7592-443e-867a-00939c497f30): created successfully Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7090fd-3f96-4a40-9b9e-dec08d221dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Flow 'volume_create_manager' (17e54a6f-7d6b-47c1-969a-a0db91626188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-16b417b3-efe1-4a65-8648-ea56d782f6bd tempest-TestServerVolumeAttachmentScenario-1468155267 None] Created volume successfully. Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[689bc838-3bb9-4291-bc8c-7d5e4c141466]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:06 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:06 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:07 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 0 in 1.200s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:07 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:07 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:08 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 1 in 1.226s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:56:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 2G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Flow 'volume_create_manager' (b28dddc0-1e9c-42cd-9f30-3a32d1fe575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ef791f-6ab0-4880-a3dd-ebfa7d8a650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 2G" returned: 0 in 0.138s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.665s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ef791f-6ab0-4880-a3dd-ebfa7d8a650c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-905800887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d40a45-32f1-437a-b692-95ac7565c8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b7c91d551aa401f85e4429aabf6fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:09Z,use_quota=True,user_id='c32d0c6921cc4ad397c2a0282d3b7d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e79cc-083b-4da4-8c0e-559e27064c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e79cc-083b-4da4-8c0e-559e27064c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddb7e19-52cc-47c8-a05b-180dff37307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddb7e19-52cc-47c8-a05b-180dff37307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d40a45-32f1-437a-b692-95ac7565c8f8', 'volume_name': 'volume-76d40a45-32f1-437a-b692-95ac7565c8f8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8740c38-f799-4c46-8aac-af984cb32a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8740c38-f799-4c46-8aac-af984cb32a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ff11f9-2c46-45ee-9a6f-568fbd42e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Volume 76d40a45-32f1-437a-b692-95ac7565c8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d40a45-32f1-437a-b692-95ac7565c8f8', 'volume_size': 1} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-905800887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d40a45-32f1-437a-b692-95ac7565c8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b7c91d551aa401f85e4429aabf6fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:09Z,use_quota=True,user_id='c32d0c6921cc4ad397c2a0282d3b7d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Creating volume 76d40a45-32f1-437a-b692-95ac7565c8f8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:56:09 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:56:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:09 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 1073741824 Jul 03 12:56:09 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-94da9644-4443-4673-93d9-587fd6182e68 tempest-VolumesExtendTest-1182119689 None] Extend volume completed successfully. Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Lock "cinder-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-quobyte-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a96d8ac-b3d1-4f5f-9d58-a1efefea70c7]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:10 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 1073741824" returned: 0 in 1.140s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:10 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 Jul 03 12:56:10 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:10 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:10 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:11 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ff11f9-2c46-45ee-9a6f-568fbd42e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d40a45-32f1-437a-b692-95ac7565c8f8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d0e142-f541-461e-8b38-7a9d4e4e3a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:11 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Volume volume-76d40a45-32f1-437a-b692-95ac7565c8f8 (76d40a45-32f1-437a-b692-95ac7565c8f8): created successfully Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d0e142-f541-461e-8b38-7a9d4e4e3a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Flow 'volume_create_manager' (b28dddc0-1e9c-42cd-9f30-3a32d1fe575a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f3c15f32-be13-49c1-b371-b5a06f7e0067 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Created volume successfully. Jul 03 12:56:11 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:11 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:12 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 1 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:56:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:12 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94 Jul 03 12:56:12 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:13 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94" released by "delete_volume" :: held 2.899s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Created reservations ['a5a81305-8638-4f43-98f7-1d0d3510ff81', '9e851bc7-2110-49c9-b704-8a25d0cff42e', '787550e1-dffb-4208-85fc-5f2c7dad7371', '75256fa8-64b5-40b3-8c8c-b8c3846fb9ad'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:13 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:56:13 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Acquiring lock "cinder-76d40a45-32f1-437a-b692-95ac7565c8f8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "cinder-76d40a45-32f1-437a-b692-95ac7565c8f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Acquiring lock "cinder-quobyte-76d40a45-32f1-437a-b692-95ac7565c8f8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "cinder-quobyte-76d40a45-32f1-437a-b692-95ac7565c8f8" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989e750-bfb4-4fc7-a94f-b6633d119eb3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:14 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 Jul 03 12:56:14 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:14 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Flow 'volume_create_manager' (c46b0275-c878-4649-a849-18be7609063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7157e3fe-a36e-4fdd-8cd8-c56aec40128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Deleted volume successfully. Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7157e3fe-a36e-4fdd-8cd8-c56aec40128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-570262199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f274b8-a57b-4d4b-b41e-4290a3792c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433509b5b8954fef95fcd636f0937968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:14Z,use_quota=True,user_id='54fa231d673345298f0572228fdec633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73117e6c-1122-4f0a-89c4-b3bfde88dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73117e6c-1122-4f0a-89c4-b3bfde88dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955ed785-59ff-423c-b366-70d1ff750bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955ed785-59ff-423c-b366-70d1ff750bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f274b8-a57b-4d4b-b41e-4290a3792c25', 'volume_name': 'volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c1abd8-36c9-433f-88fd-aba376915e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c1abd8-36c9-433f-88fd-aba376915e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2f6ede-2323-466f-81ca-c73bb97e302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Volume e3f274b8-a57b-4d4b-b41e-4290a3792c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25', 'volume_size': 1} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-570262199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f274b8-a57b-4d4b-b41e-4290a3792c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433509b5b8954fef95fcd636f0937968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:14Z,use_quota=True,user_id='54fa231d673345298f0572228fdec633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Creating volume e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:56:14 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-652d2b53-e1c3-4a97-9743-08d5336a9dcb tempest-VolumesExtendTest-1182119689 None] Lock "cinder-98dc9fc1-9442-455f-aa9e-b0ae5d6e9d94-delete_volume" released by "delete_volume" :: held 4.357s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:14 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 1073741824 Jul 03 12:56:14 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:15 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8" returned: 0 in 1.198s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:15 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8 Jul 03 12:56:15 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:15 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 1073741824" returned: 0 in 1.106s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:15 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 Jul 03 12:56:15 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:15 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76d40a45-32f1-437a-b692-95ac7565c8f8" returned: 0 in 0.820s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "cinder-quobyte-76d40a45-32f1-437a-b692-95ac7565c8f8" released by "delete_volume" :: held 2.092s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Created reservations ['d8bb7bc5-ba13-4dbd-828a-0d40b36ada06', '1ecf4c6b-9141-40fb-9469-d990c7e23a6a', '369df175-4d64-42d2-b6d1-fb9fcacf5b1f', '0a09a449-2f76-432e-869e-bbc8bb7ff2a5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:16 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:56:16 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:16 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2f6ede-2323-466f-81ca-c73bb97e302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe33f54-99dc-43e1-a399-bf8bfc0c8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Volume volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 (e3f274b8-a57b-4d4b-b41e-4290a3792c25): created successfully Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe33f54-99dc-43e1-a399-bf8bfc0c8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Flow 'volume_create_manager' (c46b0275-c878-4649-a849-18be7609063d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a0b6ce8b-7242-4c0c-bf18-082dff7499a7 tempest-VolumesExtendTest-1182119689 None] Created volume successfully. Jul 03 12:56:16 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:56:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Deleted volume successfully. Jul 03 12:56:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3538c8de-2a16-4b12-878b-346efa323bc0 tempest-VolumeQuotasNegativeTestJSON-2110611288 None] Lock "cinder-76d40a45-32f1-437a-b692-95ac7565c8f8-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Creating offline snapshot afce7f41-91ca-4ee0-bfce-1a3537e41c57 of volume e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:56:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b2bf4-2635-4f3c-935c-2369e971cafe]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:17 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 Jul 03 12:56:17 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:19 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25" returned: 0 in 1.202s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:19 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 1G Jul 03 12:56:19 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:20 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 1G" returned: 0 in 1.202s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:20 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 Jul 03 12:56:20 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:21 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57" returned: 0 in 1.537s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:21 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 is being set with open permissions: ugo+rw Jul 03 12:56:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:21 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 Jul 03 12:56:21 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:22 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:22 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info Jul 03 12:56:22 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:23 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info" returned: 0 in 1.317s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:24 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info is being set with open permissions: ugo+rw Jul 03 12:56:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:24 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info Jul 03 12:56:24 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:25 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.info" returned: 0 in 1.040s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.305s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-16c71771-e6dd-4a7d-b0ab-85c84d0a70cf tempest-VolumesExtendTest-1182119689 None] Create snapshot completed successfully Jul 03 12:56:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f0b52f-9e6f-48a6-8636-947bcbc973c2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:25 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 Jul 03 12:56:25 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:26 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25" returned: 0 in 1.273s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 2G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Flow 'volume_create_manager' (cf1d9829-8d86-4a3c-a59b-c30833c92263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3cae26-ebe1-40b5-a6c7-27897af85d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3cae26-ebe1-40b5-a6c7-27897af85d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-876044751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840b086c-97ac-4614-9a6c-f22275dcacbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f283a3821d4afd8ba182ec8598f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:27Z,use_quota=True,user_id='6ac968b63eb449dfb6c352d6ca65ab64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58be78a3-dbd8-46cd-8d4e-eb9b035f5e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58be78a3-dbd8-46cd-8d4e-eb9b035f5e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f80362-b637-4c4e-8447-a6feb054d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f80362-b637-4c4e-8447-a6feb054d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840b086c-97ac-4614-9a6c-f22275dcacbe', 'volume_name': 'volume-840b086c-97ac-4614-9a6c-f22275dcacbe', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec08a26-16c0-4696-92d0-d8a0a89cb95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec08a26-16c0-4696-92d0-d8a0a89cb95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2839784-9920-4513-b1c5-624fe48b9eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Volume 840b086c-97ac-4614-9a6c-f22275dcacbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840b086c-97ac-4614-9a6c-f22275dcacbe', 'volume_size': 1} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 2G" returned: 0 in 0.136s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.461s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-876044751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840b086c-97ac-4614-9a6c-f22275dcacbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f283a3821d4afd8ba182ec8598f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:27Z,use_quota=True,user_id='6ac968b63eb449dfb6c352d6ca65ab64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Creating volume 840b086c-97ac-4614-9a6c-f22275dcacbe {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:56:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:27 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe 1073741824 Jul 03 12:56:27 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0030a42e-22c9-44f5-bc6b-f752e74f1cab tempest-VolumesExtendTest-1182119689 None] Extend volume completed successfully. Jul 03 12:56:28 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe 1073741824" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-afce7f41-91ca-4ee0-bfce-1a3537e41c57-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-afce7f41-91ca-4ee0-bfce-1a3537e41c57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-quobyte-e3f274b8-a57b-4d4b-b41e-4290a3792c25" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:28 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe Jul 03 12:56:28 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-e3f274b8-a57b-4d4b-b41e-4290a3792c25" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-quobyte-afce7f41-91ca-4ee0-bfce-1a3537e41c57" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-afce7f41-91ca-4ee0-bfce-1a3537e41c57" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Deleting offline snapshot afce7f41-91ca-4ee0-bfce-1a3537e41c57 of volume e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] snapshot_file for this snap is: volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0761ff-94b4-4ebb-b0e6-05c6863d9da1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:28 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 Jul 03 12:56:28 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:28 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe" returned: 0 in 0.833s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2839784-9920-4513-b1c5-624fe48b9eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840b086c-97ac-4614-9a6c-f22275dcacbe', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0a254b-8104-4445-8950-76969fb2ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Volume volume-840b086c-97ac-4614-9a6c-f22275dcacbe (840b086c-97ac-4614-9a6c-f22275dcacbe): created successfully Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0a254b-8104-4445-8950-76969fb2ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Flow 'volume_create_manager' (cf1d9829-8d86-4a3c-a59b-c30833c92263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-95d611b9-9981-4ee1-b551-0f313a7161b7 tempest-VolumesServicesTestJSON-229934084 None] Created volume successfully. Jul 03 12:56:29 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57" returned: 0 in 1.038s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522840d-2929-4f0b-b6bd-705ac410137a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:29 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 Jul 03 12:56:29 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:30 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:30 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 Jul 03 12:56:30 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Acquiring lock "cinder-840b086c-97ac-4614-9a6c-f22275dcacbe-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Lock "cinder-840b086c-97ac-4614-9a6c-f22275dcacbe-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Acquiring lock "cinder-quobyte-840b086c-97ac-4614-9a6c-f22275dcacbe" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Lock "cinder-quobyte-840b086c-97ac-4614-9a6c-f22275dcacbe" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[900955d5-6b85-484d-b325-c255843f9e67]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:30 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe Jul 03 12:56:30 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:31 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57" returned: 0 in 1.450s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:31 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57 Jul 03 12:56:31 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:32 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe" returned: 0 in 1.364s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:32 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe Jul 03 12:56:32 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:32 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25.afce7f41-91ca-4ee0-bfce-1a3537e41c57" returned: 0 in 0.996s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-afce7f41-91ca-4ee0-bfce-1a3537e41c57" released by "_delete_snapshot" :: held 4.663s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-e3f274b8-a57b-4d4b-b41e-4290a3792c25" released by "delete_snapshot" :: held 4.702s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Created reservations ['d86c6023-105b-490c-93cf-1ddb1ac14ac9', '33705fdc-1383-42b6-98af-f3988bd9c1d0', '6ade4611-37c8-4bf8-8734-752ba3b41c7f', '247f5f94-eb55-4712-9e46-e166cbe91048'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:56:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Delete snapshot completed successfully. Jul 03 12:56:33 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-196fb5dd-df42-4ec8-8101-297b2fce62e9 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-afce7f41-91ca-4ee0-bfce-1a3537e41c57-delete_snapshot" released by "delete_snapshot" :: held 5.137s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-840b086c-97ac-4614-9a6c-f22275dcacbe" returned: 0 in 1.241s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Lock "cinder-quobyte-840b086c-97ac-4614-9a6c-f22275dcacbe" released by "delete_volume" :: held 2.668s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Created reservations ['36255c25-b3ad-4d65-99f3-837116b6d0f9', '36a2eea8-0d5c-4a25-8149-eff7c05df3c6', 'f01aa6a6-29d6-42f2-b8c7-b51d3a84f17a', 'd421682c-9051-44ab-8d55-3cc6db59eaf3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:33 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:56:33 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-e3f274b8-a57b-4d4b-b41e-4290a3792c25-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-e3f274b8-a57b-4d4b-b41e-4290a3792c25-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "cinder-quobyte-e3f274b8-a57b-4d4b-b41e-4290a3792c25" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-e3f274b8-a57b-4d4b-b41e-4290a3792c25" acquired by "delete_volume" :: waited 0.087s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[821449dd-f6f3-4a76-8bc0-9cc52e353dd2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:34 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 Jul 03 12:56:34 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:35 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.966s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:56:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Deleted volume successfully. Jul 03 12:56:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a99d66-0e78-4c51-b11a-27633f6301e4 tempest-VolumesServicesTestJSON-229934084 None] Lock "cinder-840b086c-97ac-4614-9a6c-f22275dcacbe-delete_volume" released by "delete_volume" :: held 5.121s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:35 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25" returned: 0 in 1.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:35 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25 Jul 03 12:56:35 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-033c0c28-5d77-4d85-bdb3-367543df1b2c tempest-TestShelveInstance-1760542803 None] Terminate volume connection completed successfully. Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-033c0c28-5d77-4d85-bdb3-367543df1b2c tempest-TestShelveInstance-1760542803 None] Deleting attachment 8f06ba65-ff84-4e96-b554-df57af986eed. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:56:36 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e3f274b8-a57b-4d4b-b41e-4290a3792c25" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-quobyte-e3f274b8-a57b-4d4b-b41e-4290a3792c25" released by "delete_volume" :: held 2.714s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Created reservations ['9d7006e9-7075-4b02-bede-d418d1d380e3', '1b31df27-2854-4102-971e-54fd4f8fafe9', 'fafbd83d-ddb7-4ac7-8cfb-c8fc42aa198e', '1f3a45f3-17e3-4624-a370-a2894a776d96'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:36 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:56:36 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Acquiring lock "cinder-e344fca5-d494-4b16-be50-264f2fd3a10d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Lock "cinder-e344fca5-d494-4b16-be50-264f2fd3a10d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Acquiring lock "cinder-quobyte-e344fca5-d494-4b16-be50-264f2fd3a10d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:56:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Lock "cinder-quobyte-e344fca5-d494-4b16-be50-264f2fd3a10d" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:56:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b731f463-292f-4b23-ac67-f16f0a9780a1]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:37 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:56:37 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:38 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.089s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:38 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:56:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Deleted volume successfully. Jul 03 12:56:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36408eb3-054a-475c-8e3f-5f9490a3df33 tempest-VolumesExtendTest-1182119689 None] Lock "cinder-e3f274b8-a57b-4d4b-b41e-4290a3792c25-delete_volume" released by "delete_volume" :: held 4.234s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:38 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 1.273s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:38 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:56:38 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:39 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 1 in 1.098s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:56:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:39 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d Jul 03 12:56:39 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:40 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e344fca5-d494-4b16-be50-264f2fd3a10d" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Lock "cinder-quobyte-e344fca5-d494-4b16-be50-264f2fd3a10d" released by "delete_volume" :: held 3.258s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG cinder.quota [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Created reservations ['1bc8ffbb-e3ff-4bb4-a418-85d926629e9d', 'bb42ae01-bc7a-4c85-8779-846e251d66a4', 'c8b6b4a8-61bb-4b79-9bc0-51aa2d031b51', 'cb0e5fe4-1be9-43f6-a377-29c937ae9c80'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:40 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:56:40 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:41 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.062s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:41 devstack cinder-volume[86966]: DEBUG cinder.manager [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:56:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Deleted volume successfully. Jul 03 12:56:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-f93fdd42-9212-4f27-aedb-9ebb9ae1b464 req-9d6572d9-be14-4f5b-9735-0f1ca1ccf376 tempest-TestShelveInstance-1760542803 None] Lock "cinder-e344fca5-d494-4b16-be50-264f2fd3a10d-delete_volume" released by "delete_volume" :: held 4.722s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=56,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=59,cinder:INSERT=24,cinder:UPDATE=74,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Flow 'volume_create_manager' (4a84e100-4bf6-4536-acff-e8675a5b9451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb654a4-8742-4bfd-88f8-461d466dda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb654a4-8742-4bfd-88f8-461d466dda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-833242634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948d7210-dc2a-4808-9c9a-878736b29577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0871d1399404057b7b6f1218afb83df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:47Z,use_quota=True,user_id='aade5611a78d4e0bba4b6a215fc0eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3f0666-2a43-4f90-bd4f-7bd7e70723ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3f0666-2a43-4f90-bd4f-7bd7e70723ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5029726-48da-4519-9f6b-ea13c32f2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5029726-48da-4519-9f6b-ea13c32f2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948d7210-dc2a-4808-9c9a-878736b29577', 'volume_name': 'volume-948d7210-dc2a-4808-9c9a-878736b29577', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4676884f-d6c8-4d3c-9176-4c59bb7e64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4676884f-d6c8-4d3c-9176-4c59bb7e64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4b258c-142d-4990-a02e-3a886137b74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Volume 948d7210-dc2a-4808-9c9a-878736b29577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948d7210-dc2a-4808-9c9a-878736b29577', 'volume_size': 1} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-833242634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948d7210-dc2a-4808-9c9a-878736b29577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0871d1399404057b7b6f1218afb83df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:47Z,use_quota=True,user_id='aade5611a78d4e0bba4b6a215fc0eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Creating volume 948d7210-dc2a-4808-9c9a-878736b29577 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:56:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:56:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:46 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 1073741824 Jul 03 12:56:46 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:48 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 1073741824" returned: 0 in 1.336s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:48 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 Jul 03 12:56:48 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:49 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4b258c-142d-4990-a02e-3a886137b74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948d7210-dc2a-4808-9c9a-878736b29577', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705f21a6-9e59-4c8e-a988-b01940af6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:56:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Volume volume-948d7210-dc2a-4808-9c9a-878736b29577 (948d7210-dc2a-4808-9c9a-878736b29577): created successfully Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705f21a6-9e59-4c8e-a988-b01940af6816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:56:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Flow 'volume_create_manager' (4a84e100-4bf6-4536-acff-e8675a5b9451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:56:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1668b56d-b314-42b7-8638-07c0e4c20cc8 tempest-VolumesNegativeTest-11502616 None] Created volume successfully. Jul 03 12:56:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:56:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:56:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0af052f-5216-49b1-9ee7-a717ce049eb6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:56:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:56:51 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 Jul 03 12:56:51 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:56:51 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 03 12:56:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:56:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:56:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-71701af7-94a9-4304-81d9-96b7f9cdaee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17c842c9-07b8-4225-8ac2-36de2b8dfa01', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:56:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-38fc0d65-9534-4888-b972-1a2235690c8c req-e132cf06-7bc2-43cd-ab1b-921618cc99a2 tempest-TestServerVolumeAttachmentScenario-1468155267 None] attachment_update completed successfully. Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:57:01 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:57:01 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:57:01 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:02 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:57:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2da526e-d874-49c0-914b-1ad9133985b8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:57:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:04 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 Jul 03 12:57:04 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:05 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30" returned: 0 in 1.414s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.436s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-0f8ab17e-7592-443e-867a-00939c497f30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5713341-4a19-49c4-ac9e-2b784b23111e', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:57:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ad5bacf4-511b-408c-b6ee-0fe3c0f4d59e req-b064222e-da2e-4020-b720-8a15887b09fe tempest-TestServerVolumeAttachmentScenario-1468155267 None] attachment_update completed successfully. Jul 03 12:57:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-974f0fbf-cba9-413b-8ad5-d5ad077c0a56 req-e0e7e44e-b527-4ed1-bec6-396057a8b111 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Terminate volume connection completed successfully. Jul 03 12:57:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-974f0fbf-cba9-413b-8ad5-d5ad077c0a56 req-e0e7e44e-b527-4ed1-bec6-396057a8b111 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Deleting attachment e5713341-4a19-49c4-ac9e-2b784b23111e. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:57:15 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:57:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-0a236216-8990-420e-be44-66f82a28f970 req-87da94ee-eefc-4eea-abaf-2689faf44d45 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Terminate volume connection completed successfully. Jul 03 12:57:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0a236216-8990-420e-be44-66f82a28f970 req-87da94ee-eefc-4eea-abaf-2689faf44d45 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Deleting attachment 17c842c9-07b8-4225-8ac2-36de2b8dfa01. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:57:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:57:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:57:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "cinder-0f8ab17e-7592-443e-867a-00939c497f30-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-0f8ab17e-7592-443e-867a-00939c497f30-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "cinder-quobyte-0f8ab17e-7592-443e-867a-00939c497f30" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-quobyte-0f8ab17e-7592-443e-867a-00939c497f30" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeffbc4-6cf6-4758-930e-c3644294936d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:57:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:31 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 Jul 03 12:57:31 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:32 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30" returned: 0 in 1.235s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:32 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30 Jul 03 12:57:32 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:34 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0f8ab17e-7592-443e-867a-00939c497f30" returned: 0 in 1.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-quobyte-0f8ab17e-7592-443e-867a-00939c497f30" released by "delete_volume" :: held 2.967s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Created reservations ['c6f9dc13-abcf-490e-92bd-ce7fc2fc15f6', 'b6ec9b9b-fb8c-4f58-a4fe-407919409b86', 'c3657f42-e30e-4136-8dc5-1b464212be89', 'a1c57854-6ae6-4113-9d9b-b1882525c1dd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:34 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:57:34 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "cinder-71701af7-94a9-4304-81d9-96b7f9cdaee6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-71701af7-94a9-4304-81d9-96b7f9cdaee6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "cinder-quobyte-71701af7-94a9-4304-81d9-96b7f9cdaee6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-quobyte-71701af7-94a9-4304-81d9-96b7f9cdaee6" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d742daa2-8359-457b-8aae-f99465b241fa]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:57:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:35 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 Jul 03 12:57:35 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:36 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.374s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:57:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Deleted volume successfully. Jul 03 12:57:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf338a42-f9d5-49e4-9fbc-6eb6c3c93960 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-0f8ab17e-7592-443e-867a-00939c497f30-delete_volume" released by "delete_volume" :: held 4.795s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:38 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6" returned: 0 in 2.506s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:38 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6 Jul 03 12:57:38 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:39 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-71701af7-94a9-4304-81d9-96b7f9cdaee6" returned: 0 in 1.187s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-quobyte-71701af7-94a9-4304-81d9-96b7f9cdaee6" released by "delete_volume" :: held 3.811s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Created reservations ['16977e11-028f-4f8e-a89a-2efcc2de1d5d', 'ff08207c-0194-4671-901b-72cb2993bfdd', '8419a186-7429-4f5f-9695-58216fb45e89', '254e9fc7-657d-4e0b-8c71-531f4b124edf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:39 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:57:39 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:40 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.292s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:57:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Deleted volume successfully. Jul 03 12:57:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-49c6227a-2a88-4978-ab7b-867af16ab815 tempest-TestServerVolumeAttachmentScenario-1468155267 None] Lock "cinder-71701af7-94a9-4304-81d9-96b7f9cdaee6-delete_volume" released by "delete_volume" :: held 5.713s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (66d2b468-48d2-430c-a126-bfe72f930cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684b755b-9406-4595-bcc2-f239d9e23f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684b755b-9406-4595-bcc2-f239d9e23f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-248417902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150673a9-2236-4614-acea-ee0104b5787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:45Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0d0952-8202-4cef-9e3e-05979b4cb948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0d0952-8202-4cef-9e3e-05979b4cb948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3093f89-5b42-4589-9510-7e6a3640b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3093f89-5b42-4589-9510-7e6a3640b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150673a9-2236-4614-acea-ee0104b5787a', 'volume_name': 'volume-150673a9-2236-4614-acea-ee0104b5787a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1edd876-4d4c-4230-ba59-6150b02dd9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1edd876-4d4c-4230-ba59-6150b02dd9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc25314e-896f-4772-8f98-7006024a1a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Volume 150673a9-2236-4614-acea-ee0104b5787a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150673a9-2236-4614-acea-ee0104b5787a', 'volume_size': 1} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-248417902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150673a9-2236-4614-acea-ee0104b5787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:45Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Creating volume 150673a9-2236-4614-acea-ee0104b5787a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:57:44 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:44 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a 1073741824 Jul 03 12:57:44 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Flow 'volume_create_manager' (e6678140-4c97-481e-b3eb-3f98bf164cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:57:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ed69e6-7a79-47cc-ac24-af0f3569548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ed69e6-7a79-47cc-ac24-af0f3569548e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-462085614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843f71cd0a4c4324ba086b1fe3c047c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:45Z,use_quota=True,user_id='a7b33cf9ad99465a9303b788ddecbc1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12a7d30-fb15-47c0-b7de-b5f799f1b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12a7d30-fb15-47c0-b7de-b5f799f1b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf84d19e-0089-4383-82f9-2a15f1cdeb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf84d19e-0089-4383-82f9-2a15f1cdeb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af', 'volume_name': 'volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40613721-fa78-4b8f-bfd8-8e4f7ea0d38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40613721-fa78-4b8f-bfd8-8e4f7ea0d38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32388470-e76b-4b28-a8c5-2bab9afc8f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Volume 73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af', 'volume_size': 1} Jul 03 12:57:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:46 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a 1073741824" returned: 0 in 1.883s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:46 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a Jul 03 12:57:46 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:48 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a" returned: 0 in 1.297s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] <== create_volume: return (3314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.322s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.926s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-462085614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843f71cd0a4c4324ba086b1fe3c047c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:45Z,use_quota=True,user_id='a7b33cf9ad99465a9303b788ddecbc1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Creating volume 73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:57:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:48 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af 1073741824 Jul 03 12:57:48 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc25314e-896f-4772-8f98-7006024a1a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150673a9-2236-4614-acea-ee0104b5787a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9118bdd9-7ed6-4d54-97e3-40b737816022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Volume volume-150673a9-2236-4614-acea-ee0104b5787a (150673a9-2236-4614-acea-ee0104b5787a): created successfully Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9118bdd9-7ed6-4d54-97e3-40b737816022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (66d2b468-48d2-430c-a126-bfe72f930cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:57:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fe416990-0107-4052-b679-cd61e44ef3fd tempest-VolumesActionsTest-1710539886 None] Created volume successfully. Jul 03 12:57:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e4a1efd2-1559-443e-ad1a-1846b4a9d7aa tempest-VolumesActionsTest-1710539886 None] Acquiring lock "cinder-150673a9-2236-4614-acea-ee0104b5787a" by "attach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e4a1efd2-1559-443e-ad1a-1846b4a9d7aa tempest-VolumesActionsTest-1710539886 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a" acquired by "attach_volume" :: waited 0.072s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e4a1efd2-1559-443e-ad1a-1846b4a9d7aa tempest-VolumesActionsTest-1710539886 None] Attaching volume 150673a9-2236-4614-acea-ee0104b5787a to instance 4aa79243-90bc-40f9-9dec-72793a08c9ac at mountpoint /dev/vdb on host None. Jul 03 12:57:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e4a1efd2-1559-443e-ad1a-1846b4a9d7aa tempest-VolumesActionsTest-1710539886 None] Attach volume completed successfully. Jul 03 12:57:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e4a1efd2-1559-443e-ad1a-1846b4a9d7aa tempest-VolumesActionsTest-1710539886 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a" released by "attach_volume" :: held 0.212s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:49 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af 1073741824" returned: 0 in 1.611s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:49 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 12:57:49 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9731c82-af2e-4185-9db6-671bd823342d tempest-VolumesActionsTest-1100799804 None] Terminate volume connection completed successfully. Jul 03 12:57:51 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 1.442s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] <== create_volume: return (3125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.128s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32388470-e76b-4b28-a8c5-2bab9afc8f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8254fbb1-6445-48a5-b25c-d6e963f874ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:57:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Volume volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af (73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af): created successfully Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8254fbb1-6445-48a5-b25c-d6e963f874ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Flow 'volume_create_manager' (e6678140-4c97-481e-b3eb-3f98bf164cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:57:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9792be2d-4550-4f82-805f-29a21f321e25 tempest-TestStampPattern-165122556 None] Created volume successfully. Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9731c82-af2e-4185-9db6-671bd823342d tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9731c82-af2e-4185-9db6-671bd823342d tempest-VolumesActionsTest-1100799804 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9731c82-af2e-4185-9db6-671bd823342d tempest-VolumesActionsTest-1100799804 None] Detaching volume 150673a9-2236-4614-acea-ee0104b5787a from instance 4aa79243-90bc-40f9-9dec-72793a08c9ac. Jul 03 12:57:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9731c82-af2e-4185-9db6-671bd823342d tempest-VolumesActionsTest-1100799804 None] Detach volume completed successfully. Jul 03 12:57:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9731c82-af2e-4185-9db6-671bd823342d tempest-VolumesActionsTest-1100799804 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e1dad41-d5bf-4b65-81d0-b7fed009f2cb tempest-VolumesActionsTest-1710539886 None] Acquiring lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e1dad41-d5bf-4b65-81d0-b7fed009f2cb tempest-VolumesActionsTest-1710539886 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9e1dad41-d5bf-4b65-81d0-b7fed009f2cb tempest-VolumesActionsTest-1710539886 None] Volume detach called, but volume not attached. Jul 03 12:57:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9e1dad41-d5bf-4b65-81d0-b7fed009f2cb tempest-VolumesActionsTest-1710539886 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "cinder-quobyte-150673a9-2236-4614-acea-ee0104b5787a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Lock "cinder-quobyte-150673a9-2236-4614-acea-ee0104b5787a" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[52da1dbe-4249-45c0-9547-11475b7c9c92]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:57:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:53 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a Jul 03 12:57:53 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:55 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a" returned: 0 in 1.459s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:55 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a Jul 03 12:57:55 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:56 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-150673a9-2236-4614-acea-ee0104b5787a" returned: 0 in 1.116s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Lock "cinder-quobyte-150673a9-2236-4614-acea-ee0104b5787a" released by "delete_volume" :: held 2.660s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Created reservations ['735b3cd3-a4e7-4557-9c15-0062a34e89c0', '1005f6dc-f6fa-415e-9070-7547b271ef6c', 'bcd23594-ed16-4967-92a3-33b3f7254143', '55ce7743-7da4-442c-9411-ce055b61c365'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:56 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:57:56 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:57 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.049s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:57:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Deleted volume successfully. Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bfdb35e8-929f-45c0-952e-85bc2ee0b7e9 tempest-VolumesActionsTest-1710539886 None] Lock "cinder-150673a9-2236-4614-acea-ee0104b5787a-delete_volume" released by "delete_volume" :: held 4.119s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Acquiring lock "cinder-948d7210-dc2a-4808-9c9a-878736b29577-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Lock "cinder-948d7210-dc2a-4808-9c9a-878736b29577-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Acquiring lock "cinder-quobyte-948d7210-dc2a-4808-9c9a-878736b29577" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:57:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Lock "cinder-quobyte-948d7210-dc2a-4808-9c9a-878736b29577" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:57:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1944050e-36a9-4b37-a060-837646a7ef67]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:57:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:58 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 Jul 03 12:57:58 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:57:59 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 03 12:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577" returned: 0 in 1.294s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:57:59 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577 Jul 03 12:57:59 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:00 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-948d7210-dc2a-4808-9c9a-878736b29577" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Lock "cinder-quobyte-948d7210-dc2a-4808-9c9a-878736b29577" released by "delete_volume" :: held 2.126s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Created reservations ['a9c20ad4-8ef6-4e58-a5a0-1b42868278a6', 'f63e7119-4cf9-4a35-8d17-dd84f5c35f2b', '1572a52f-f31c-4380-900c-1a292d1f95f2', '8f92e091-6856-4e66-add0-c5a40b0f16c3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:00 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:00 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:01 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Deleted volume successfully. Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ba430c45-2600-4bcf-bd2e-de8a83f3ccff tempest-VolumesNegativeTest-11502616 None] Lock "cinder-948d7210-dc2a-4808-9c9a-878736b29577-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:01 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:01 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:03 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.516s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (0e90d891-9718-4ee1-8c9f-75cd0cd4aec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fdd1db-d586-4da5-8dcd-3f48dbcf41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fdd1db-d586-4da5-8dcd-3f48dbcf41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-328822916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8d0146-d5d4-47ea-844e-4840346950a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:05Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3544a4-b71a-4cba-88b4-8eb1503b35f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3544a4-b71a-4cba-88b4-8eb1503b35f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa98a0f8-1178-4a57-a1a0-075fe6aa7781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa98a0f8-1178-4a57-a1a0-075fe6aa7781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8d0146-d5d4-47ea-844e-4840346950a9', 'volume_name': 'volume-0b8d0146-d5d4-47ea-844e-4840346950a9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef20347-1f4d-4b45-84c6-6d95d7d3fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef20347-1f4d-4b45-84c6-6d95d7d3fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbdb45b5-486e-4d32-acf2-f2bad1367c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Volume 0b8d0146-d5d4-47ea-844e-4840346950a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8d0146-d5d4-47ea-844e-4840346950a9', 'volume_size': 1} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-328822916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8d0146-d5d4-47ea-844e-4840346950a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:05Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Creating volume 0b8d0146-d5d4-47ea-844e-4840346950a9 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:05 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:05 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 1073741824 Jul 03 12:58:05 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Flow 'volume_create_manager' (13968d55-c353-4381-8a41-bae61fcc8e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da09304-80c3-4699-93a0-85e467b52f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da09304-80c3-4699-93a0-85e467b52f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0a388e-1f86-4e41-b14b-fece22a619e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5341d49ee240968c642468518e6b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:06Z,use_quota=True,user_id='e6821cf336b94b859f22aaf1a4e769a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf4cdcf-eb3c-41f8-92d3-82f79a6ca7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf4cdcf-eb3c-41f8-92d3-82f79a6ca7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405694b9-7632-4b49-8b20-8043442c9112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:06 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 12:58:07 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 1073741824" returned: 0 in 1.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405694b9-7632-4b49-8b20-8043442c9112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac0a388e-1f86-4e41-b14b-fece22a619e5', 'volume_name': 'volume-ac0a388e-1f86-4e41-b14b-fece22a619e5', 'volume_size': 1, 'image_id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74bb3c088779dec6ea0986d516c2e834', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d5341d49ee240968c642468518e6b71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fba288e2b7e157c747250b9b61a02a8f7b320d8e337de5ade079d7a0f8e0650b31e34f4d0e2a2d741990a80db4bde8c6e8138dfb8ef7b8261e9ccf45fa44d013', 'id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'created_at': datetime.datetime(2026, 7, 3, 10, 58, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b96d70-7a48-4492-ba69-37e3f819b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b96d70-7a48-4492-ba69-37e3f819b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f55b3a3-c5a7-4310-ad9a-8b7210c822ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Volume ac0a388e-1f86-4e41-b14b-fece22a619e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac0a388e-1f86-4e41-b14b-fece22a619e5', 'volume_size': 1, 'image_id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74bb3c088779dec6ea0986d516c2e834', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d5341d49ee240968c642468518e6b71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fba288e2b7e157c747250b9b61a02a8f7b320d8e337de5ade079d7a0f8e0650b31e34f4d0e2a2d741990a80db4bde8c6e8138dfb8ef7b8261e9ccf45fa44d013', 'id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'created_at': datetime.datetime(2026, 7, 3, 10, 58, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d/file', 'properties': {}}, 'image_service': } Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Trying to clone ac0a388e-1f86-4e41-b14b-fece22a619e5 from image e4bfcdef-906d-42ea-8b9a-41a6e400ad6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:07 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 Jul 03 12:58:07 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 12:58:07 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Image download 0.00 MB at 0.00 MB/s Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c7b470-8b96-4497-9ba2-6aa38ec13090]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:07 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD Jul 03 12:58:07 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:08 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9" returned: 0 in 1.347s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] <== create_volume: return (3491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.496s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbdb45b5-486e-4d32-acf2-f2bad1367c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8d0146-d5d4-47ea-844e-4840346950a9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd325219-dc59-4308-8c99-26ef6ba1a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Volume volume-0b8d0146-d5d4-47ea-844e-4840346950a9 (0b8d0146-d5d4-47ea-844e-4840346950a9): created successfully Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd325219-dc59-4308-8c99-26ef6ba1a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (0e90d891-9718-4ee1-8c9f-75cd0cd4aec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7db3d8cf-c0bb-43b0-8751-2a29e568cd41 tempest-VolumesActionsTest-1710539886 None] Created volume successfully. Jul 03 12:58:09 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD" returned: 0 in 1.224s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:09 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD Jul 03 12:58:09 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-0b8d0146-d5d4-47ea-844e-4840346950a9-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Lock "cinder-0b8d0146-d5d4-47ea-844e-4840346950a9-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-quobyte-0b8d0146-d5d4-47ea-844e-4840346950a9" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-0b8d0146-d5d4-47ea-844e-4840346950a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ac39eb-b083-4764-9fd9-1b46bc14f03d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:10 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD" returned: 1 in 1.291s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Temporary image e4bfcdef-906d-42ea-8b9a-41a6e400ad6d is fetched for user e6821cf336b94b859f22aaf1a4e769a4. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 12:58:10 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 Jul 03 12:58:10 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe80221-eaed-4f05-bb41-d5001a5d5322]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:10 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD Jul 03 12:58:10 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:11 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9" returned: 0 in 1.208s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:11 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9 Jul 03 12:58:11 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:11 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD" returned: 0 in 1.259s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:12 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD Jul 03 12:58:12 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:12 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0b8d0146-d5d4-47ea-844e-4840346950a9" returned: 0 in 1.585s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-0b8d0146-d5d4-47ea-844e-4840346950a9" released by "delete_volume" :: held 2.863s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Created reservations ['ce4e4308-09db-4184-9381-043fb5e02222', 'a856b343-a351-4d04-9406-ec05575ff4ff', '35d54250-e517-4ea5-8907-82d0506dd6ee', 'd5819778-c61a-40d1-ada0-34eff44eb497'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:13 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD" returned: 1 in 1.638s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0a388e-1f86-4e41-b14b-fece22a619e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5341d49ee240968c642468518e6b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:06Z,use_quota=True,user_id='e6821cf336b94b859f22aaf1a4e769a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Creating volume ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:13 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:13 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:13 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:13 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 1073741824 Jul 03 12:58:13 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:14 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.190s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Deleted volume successfully. Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-877445e9-71f2-47e7-b59b-d14e879ae25b tempest-VolumesActionsTest-1100799804 None] Lock "cinder-0b8d0146-d5d4-47ea-844e-4840346950a9-delete_volume" released by "delete_volume" :: held 4.601s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (1e743ae1-9d15-452f-bdb1-cef855ad3ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97abb309-2242-4bf8-9335-c0318cb3ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97abb309-2242-4bf8-9335-c0318cb3ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1761322758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1226ae0-d272-440f-8f80-64525163e185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:15Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b18998-46be-4fac-9f65-ca75beb183cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b18998-46be-4fac-9f65-ca75beb183cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3137f4c2-8b5b-4f22-98f8-8ccafe892265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3137f4c2-8b5b-4f22-98f8-8ccafe892265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1226ae0-d272-440f-8f80-64525163e185', 'volume_name': 'volume-b1226ae0-d272-440f-8f80-64525163e185', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613efef2-e3cb-421d-a83b-73413bb54e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613efef2-e3cb-421d-a83b-73413bb54e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c9016a-4f24-4d4a-93c7-2feaa5cdeeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Volume b1226ae0-d272-440f-8f80-64525163e185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1226ae0-d272-440f-8f80-64525163e185', 'volume_size': 1} Jul 03 12:58:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:15 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 1073741824" returned: 0 in 1.625s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:15 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:15 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:16 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 0 in 1.174s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] <== create_volume: return (2885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.891s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1761322758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1226ae0-d272-440f-8f80-64525163e185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:15Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Creating volume b1226ae0-d272-440f-8f80-64525163e185 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:16 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 1073741824 Jul 03 12:58:16 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Attempting download of e4bfcdef-906d-42ea-8b9a-41a6e400ad6d ((None, [{'url': 'file:///opt/stack/data/glance/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'metadata': {}}])) to volume ac0a388e-1f86-4e41-b14b-fece22a619e5. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2308e-d799-4932-a55b-6d378f9d9bca]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:16 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5 Jul 03 12:58:16 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:17 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5" returned: 0 in 1.315s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:17 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 1073741824" returned: 0 in 1.660s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:18 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 Jul 03 12:58:18 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:18 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5 Jul 03 12:58:18 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:18 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185" returned: 0 in 0.910s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.673s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c9016a-4f24-4d4a-93c7-2feaa5cdeeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1226ae0-d272-440f-8f80-64525163e185', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2772c005-9628-4062-8fed-0c0f4fc3749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Volume volume-b1226ae0-d272-440f-8f80-64525163e185 (b1226ae0-d272-440f-8f80-64525163e185): created successfully Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2772c005-9628-4062-8fed-0c0f4fc3749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (1e743ae1-9d15-452f-bdb1-cef855ad3ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7386c6c1-1384-43a3-beea-1ff6e150ca26 tempest-VolumesActionsTest-1710539886 None] Created volume successfully. Jul 03 12:58:19 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5" returned: 1 in 1.284s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_0y2cb9q5' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e26278-4be0-4b98-a8a6-2b0bffa13d64]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:19 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD Jul 03 12:58:19 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-b1226ae0-d272-440f-8f80-64525163e185-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-b1226ae0-d272-440f-8f80-64525163e185-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-quobyte-b1226ae0-d272-440f-8f80-64525163e185" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-b1226ae0-d272-440f-8f80-64525163e185" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaffd5ae-fc2c-4cb0-adaf-2d3053b74eff]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:19 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 Jul 03 12:58:19 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:20 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:20 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD Jul 03 12:58:20 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:20 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185" returned: 0 in 1.175s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:20 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185 Jul 03 12:58:20 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:21 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD" returned: 1 in 1.141s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:21 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] e4bfcdef-906d-42ea-8b9a-41a6e400ad6d was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 12:58:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:21 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:21 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:22 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b1226ae0-d272-440f-8f80-64525163e185" returned: 0 in 1.227s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-b1226ae0-d272-440f-8f80-64525163e185" released by "delete_volume" :: held 2.454s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Created reservations ['eaf01bf0-35fd-46bc-af8a-b7dcc682df5e', '727c2127-6b0b-4e5a-a4f5-cb39ef69b7f1', '785229e5-7d7c-4691-9b3e-d5eb2940084c', '29b69243-bfc3-46d0-a75f-b74774c5e693'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:22 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:22 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:22 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 0 in 1.105s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4bfcdef-906d-42ea-8b9a-41a6e400ad6d_9qf54g1jdevstack@QuobyteHD, size 0.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:58:22 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 12:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:22 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 1G Jul 03 12:58:22 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:23 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.024s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Deleted volume successfully. Jul 03 12:58:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3d74927-561b-4152-af96-f03c416b6a82 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-b1226ae0-d272-440f-8f80-64525163e185-delete_volume" released by "delete_volume" :: held 3.822s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:23 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 1G" returned: 0 in 1.049s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e0c767-3885-4cee-b805-cbbbd8a0b844]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:23 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:23 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (7624dbd1-9b37-4f75-872c-6e18e689abf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aafc2b0-a57d-4ff3-bf51-5db1f25a2363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aafc2b0-a57d-4ff3-bf51-5db1f25a2363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044300373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b05221a-9c56-4b86-bcf2-19dc61094c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:24Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e70fe5-d9b7-421d-8fd7-47e47d0dbc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e70fe5-d9b7-421d-8fd7-47e47d0dbc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e965f3-c4b0-4518-8f0b-56bf1e131281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e965f3-c4b0-4518-8f0b-56bf1e131281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b05221a-9c56-4b86-bcf2-19dc61094c28', 'volume_name': 'volume-2b05221a-9c56-4b86-bcf2-19dc61094c28', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677c58cc-5ffa-44ab-8d04-2f458f67c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677c58cc-5ffa-44ab-8d04-2f458f67c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e09f63-b329-4f24-8d71-59b7c175bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Volume 2b05221a-9c56-4b86-bcf2-19dc61094c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b05221a-9c56-4b86-bcf2-19dc61094c28', 'volume_size': 1} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044300373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b05221a-9c56-4b86-bcf2-19dc61094c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:24Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Creating volume 2b05221a-9c56-4b86-bcf2-19dc61094c28 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:24 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:24 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 1073741824 Jul 03 12:58:24 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:24 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 0 in 1.383s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:25 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:25 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:26 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 1073741824" returned: 0 in 1.934s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:26 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 Jul 03 12:58:26 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:26 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 1 in 1.576s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Downloaded image e4bfcdef-906d-42ea-8b9a-41a6e400ad6d ((None, [{'url': 'file:///opt/stack/data/glance/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'metadata': {}}])) to volume ac0a388e-1f86-4e41-b14b-fece22a619e5 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Temporary image e4bfcdef-906d-42ea-8b9a-41a6e400ad6d for user e6821cf336b94b859f22aaf1a4e769a4 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Marking volume ac0a388e-1f86-4e41-b14b-fece22a619e5 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=67,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Copying metadata from image e4bfcdef-906d-42ea-8b9a-41a6e400ad6d to ac0a388e-1f86-4e41-b14b-fece22a619e5. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Creating volume glance metadata for volume ac0a388e-1f86-4e41-b14b-fece22a619e5 backed by image e4bfcdef-906d-42ea-8b9a-41a6e400ad6d with: {'image_id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '74bb3c088779dec6ea0986d516c2e834', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=56,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f55b3a3-c5a7-4310-ad9a-8b7210c822ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0a388e-1f86-4e41-b14b-fece22a619e5', 'volume_size': 1, 'image_id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74bb3c088779dec6ea0986d516c2e834', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d5341d49ee240968c642468518e6b71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fba288e2b7e157c747250b9b61a02a8f7b320d8e337de5ade079d7a0f8e0650b31e34f4d0e2a2d741990a80db4bde8c6e8138dfb8ef7b8261e9ccf45fa44d013', 'id': 'e4bfcdef-906d-42ea-8b9a-41a6e400ad6d', 'created_at': datetime.datetime(2026, 7, 3, 10, 58, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4bfcdef-906d-42ea-8b9a-41a6e400ad6d/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49efbff6-804c-4cb2-b2f6-e5832afca0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Volume volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 (ac0a388e-1f86-4e41-b14b-fece22a619e5): created successfully Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49efbff6-804c-4cb2-b2f6-e5832afca0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Flow 'volume_create_manager' (13968d55-c353-4381-8a41-bae61fcc8e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9820339-b7ea-4aee-9b2d-df8ab1fc62ef tempest-VolumeImageDependencyTests-1836893698 None] Created volume successfully. Jul 03 12:58:27 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28" returned: 0 in 1.116s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] <== create_volume: return (3139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.142s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e09f63-b329-4f24-8d71-59b7c175bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b05221a-9c56-4b86-bcf2-19dc61094c28', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb48b8e-cecb-4680-859a-6f96b16f0e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Volume volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 (2b05221a-9c56-4b86-bcf2-19dc61094c28): created successfully Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb48b8e-cecb-4680-859a-6f96b16f0e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (7624dbd1-9b37-4f75-872c-6e18e689abf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c82311b2-1bb9-47ad-ba45-4b2a03153c3d tempest-VolumesActionsTest-1710539886 None] Created volume successfully. Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Acquiring lock "cinder-ac0a388e-1f86-4e41-b14b-fece22a619e5-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Lock "cinder-ac0a388e-1f86-4e41-b14b-fece22a619e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Acquiring lock "cinder-quobyte-ac0a388e-1f86-4e41-b14b-fece22a619e5" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Lock "cinder-quobyte-ac0a388e-1f86-4e41-b14b-fece22a619e5" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[96333646-026a-4ecc-b335-29feaf9d9191]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:27 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:27 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-2b05221a-9c56-4b86-bcf2-19dc61094c28-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-2b05221a-9c56-4b86-bcf2-19dc61094c28-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-quobyte-2b05221a-9c56-4b86-bcf2-19dc61094c28" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-2b05221a-9c56-4b86-bcf2-19dc61094c28" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3779fd8-8419-4ba7-a397-ee88dee7b96b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:28 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:28 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 Jul 03 12:58:28 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:28 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:28 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:29 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 1 in 0.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:29 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28" returned: 0 in 0.981s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:29 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5 Jul 03 12:58:29 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:29 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28 Jul 03 12:58:29 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:30 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ac0a388e-1f86-4e41-b14b-fece22a619e5" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Lock "cinder-quobyte-ac0a388e-1f86-4e41-b14b-fece22a619e5" released by "delete_volume" :: held 2.653s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Created reservations ['6088a31b-ca4f-4ccf-a3fd-00284e2ea5b1', 'f647d73b-a370-4e9e-93ff-ffcf326e5fa1', 'f61bab45-75c4-4d78-b440-47e2755f76e7', '786ce169-91ae-4cf9-8d78-b121f863f6d7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:30 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2b05221a-9c56-4b86-bcf2-19dc61094c28" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-2b05221a-9c56-4b86-bcf2-19dc61094c28" released by "delete_volume" :: held 2.062s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:30 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:30 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Created reservations ['40c82b9e-dc00-4503-9e7c-dd74ffeefad8', '9e7902c4-524a-4a2c-a6c9-d74385235304', 'e15ed809-804c-44bb-8e9d-ae5cfb3c7755', '2b26dd2c-78f9-4130-8a8e-5e720941090a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:30 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:30 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfe0c1f-3b18-43fa-82a7-4dfefc4b8bb9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:31 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 12:58:31 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:31 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.184s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:31 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Deleted volume successfully. Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e196ad45-a1f6-4cb6-842b-6c157828a58e tempest-VolumeImageDependencyTests-1836893698 None] Lock "cinder-ac0a388e-1f86-4e41-b14b-fece22a619e5-delete_volume" released by "delete_volume" :: held 4.308s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:32 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.161s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Deleted volume successfully. Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-82cfd8ba-9385-4911-92ce-f4575db62d76 tempest-VolumesActionsTest-1100799804 None] Lock "cinder-2b05221a-9c56-4b86-bcf2-19dc61094c28-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (6f61d73b-7322-4a33-905b-008a302c8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64833b1f-30e7-4f11-958a-11fdeb86bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64833b1f-30e7-4f11-958a-11fdeb86bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601537449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff0b63f-8d94-4abd-94e1-6163d4eccf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:33Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a269f272-7813-4442-a458-59d04ca6a9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a269f272-7813-4442-a458-59d04ca6a9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ccd544-2e4a-4b60-9986-2a7315ff426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ccd544-2e4a-4b60-9986-2a7315ff426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff0b63f-8d94-4abd-94e1-6163d4eccf88', 'volume_name': 'volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b4604a-c877-43c7-b6ce-493aaedb9ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b4604a-c877-43c7-b6ce-493aaedb9ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555978a8-29e5-478b-a34e-58c3eeee7855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Volume bff0b63f-8d94-4abd-94e1-6163d4eccf88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88', 'volume_size': 1} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:33 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 1.356s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.397s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601537449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff0b63f-8d94-4abd-94e1-6163d4eccf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:33Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Creating volume bff0b63f-8d94-4abd-94e1-6163d4eccf88 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:33 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:33 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 1073741824 Jul 03 12:58:33 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a927859-5c03-4f36-8b2d-162e31c53152', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:58:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b0895587-85ab-463d-8ced-398ba2e28cc4 req-40ac6d21-b52e-4c88-bf00-e504e4ba2a10 tempest-TestStampPattern-165122556 None] attachment_update completed successfully. Jul 03 12:58:34 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 1073741824" returned: 0 in 1.560s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:34 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 Jul 03 12:58:34 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:35 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88" returned: 0 in 0.983s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] <== create_volume: return (2611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555978a8-29e5-478b-a34e-58c3eeee7855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3b56d6-6fa8-4f57-a4a6-d78a036e66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Volume volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 (bff0b63f-8d94-4abd-94e1-6163d4eccf88): created successfully Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3b56d6-6fa8-4f57-a4a6-d78a036e66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (6f61d73b-7322-4a33-905b-008a302c8b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f80e2c2b-7f1a-4d81-8c99-0f03816014b5 tempest-VolumesActionsTest-1710539886 None] Created volume successfully. Jul 03 12:58:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-bff0b63f-8d94-4abd-94e1-6163d4eccf88-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Lock "cinder-bff0b63f-8d94-4abd-94e1-6163d4eccf88-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Acquiring lock "cinder-quobyte-bff0b63f-8d94-4abd-94e1-6163d4eccf88" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-bff0b63f-8d94-4abd-94e1-6163d4eccf88" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f8203-d6c2-410a-88b0-f8d9d0f00f35]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:36 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 Jul 03 12:58:36 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:37 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88" returned: 0 in 1.195s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:37 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88 Jul 03 12:58:37 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:38 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bff0b63f-8d94-4abd-94e1-6163d4eccf88" returned: 0 in 0.983s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Lock "cinder-quobyte-bff0b63f-8d94-4abd-94e1-6163d4eccf88" released by "delete_volume" :: held 2.257s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Created reservations ['20ce00fa-b0f2-4122-a328-32d5feebdf7a', '05721afe-8498-4f7a-88fe-7093f845dd40', '9c51b27b-61f2-47a1-b30c-9ca8e6a6464c', 'b8204b15-aaf0-4134-b7f4-1e981cdd334d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:39 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:39 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:40 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.369s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Deleted volume successfully. Jul 03 12:58:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6758ff64-17cd-433c-aab5-c66052af9c7e tempest-VolumesActionsTest-1100799804 None] Lock "cinder-bff0b63f-8d94-4abd-94e1-6163d4eccf88-delete_volume" released by "delete_volume" :: held 4.044s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (b8def59b-36a2-4a63-9042-9e9206471ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d18a9f-9d73-49f7-8aa1-6108ab52bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d18a9f-9d73-49f7-8aa1-6108ab52bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2129979995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c024ca3c-ac2a-46d1-a313-c4a069d25a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:41Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498eb7a1-d60a-4f9f-9e7a-8f35fa3a9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498eb7a1-d60a-4f9f-9e7a-8f35fa3a9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2b5984-ac67-4220-ac0f-ca45eb0eaabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2b5984-ac67-4220-ac0f-ca45eb0eaabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c024ca3c-ac2a-46d1-a313-c4a069d25a0f', 'volume_name': 'volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421aa1dc-2f9f-4214-a2b0-cd1b2372167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421aa1dc-2f9f-4214-a2b0-cd1b2372167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37ebde-e26f-4974-a482-f90c38ceff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Volume c024ca3c-ac2a-46d1-a313-c4a069d25a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f', 'volume_size': 1} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2129979995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c024ca3c-ac2a-46d1-a313-c4a069d25a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c5bb0aa0a447b6be53a0fffb10fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:41Z,use_quota=True,user_id='fbdc0e1fa6554176ac3ae905cf789327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Creating volume c024ca3c-ac2a-46d1-a313-c4a069d25a0f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:41 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f 1073741824 Jul 03 12:58:41 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:42 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f 1073741824" returned: 0 in 1.307s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:42 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f Jul 03 12:58:42 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:43 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37ebde-e26f-4974-a482-f90c38ceff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7750fe13-715e-4d97-b351-b90c2d37292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Volume volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f (c024ca3c-ac2a-46d1-a313-c4a069d25a0f): created successfully Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7750fe13-715e-4d97-b351-b90c2d37292f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Flow 'volume_create_manager' (b8def59b-36a2-4a63-9042-9e9206471ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c733bb2c-b8ee-4dc8-92f6-3fd413d7342c tempest-VolumesActionsTest-1710539886 None] Created volume successfully. Jul 03 12:58:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-423f189e-c810-4ad8-b13b-7dcf22f4d01c req-96946fa6-c459-4251-adc5-0915a56804b8 tempest-TestStampPattern-165122556 None] Terminate volume connection completed successfully. Jul 03 12:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-423f189e-c810-4ad8-b13b-7dcf22f4d01c req-96946fa6-c459-4251-adc5-0915a56804b8 tempest-TestStampPattern-165122556 None] Deleting attachment 4a927859-5c03-4f36-8b2d-162e31c53152. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 12:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Acquiring lock "cinder-c024ca3c-ac2a-46d1-a313-c4a069d25a0f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Lock "cinder-c024ca3c-ac2a-46d1-a313-c4a069d25a0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Acquiring lock "cinder-quobyte-c024ca3c-ac2a-46d1-a313-c4a069d25a0f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Lock "cinder-quobyte-c024ca3c-ac2a-46d1-a313-c4a069d25a0f" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:58:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bd46ee-575d-4a17-847c-87dc03699740]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:44 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f Jul 03 12:58:44 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Flow 'volume_create_manager' (98dba930-d0e9-45ff-8472-0c7814b1a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cc5dc2-4bc8-4d9a-af4a-845dacf6a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cc5dc2-4bc8-4d9a-af4a-845dacf6a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1968123160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e37c387-3df0-4f7c-a575-ecaf86e00bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bf9f13a0d24075a8779a32d803251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:45Z,use_quota=True,user_id='3f8aa4078ca0482ba5eea88691ec7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c72dbe-9678-4397-8f0a-8de14fb1fd33),volume_type_id=e5c72dbe-9678-4397-8f0a-8de14fb1fd33)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a81299d-0975-4b96-b2ea-bc19a77da278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a81299d-0975-4b96-b2ea-bc19a77da278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863d0f53-d0dc-4d4c-91c7-1722f72244ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863d0f53-d0dc-4d4c-91c7-1722f72244ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e37c387-3df0-4f7c-a575-ecaf86e00bf8', 'volume_name': 'volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17ae997-f4ac-4684-ba68-8ae0f03edf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17ae997-f4ac-4684-ba68-8ae0f03edf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e622ca9-3e6a-4d26-8f2d-a60bd831a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume 2e37c387-3df0-4f7c-a575-ecaf86e00bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8', 'volume_size': 1} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1968123160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e37c387-3df0-4f7c-a575-ecaf86e00bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bf9f13a0d24075a8779a32d803251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:45Z,use_quota=True,user_id='3f8aa4078ca0482ba5eea88691ec7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c72dbe-9678-4397-8f0a-8de14fb1fd33),volume_type_id=e5c72dbe-9678-4397-8f0a-8de14fb1fd33)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Creating volume 2e37c387-3df0-4f7c-a575-ecaf86e00bf8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:45 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:45 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 1073741824 Jul 03 12:58:45 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:45 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f" returned: 0 in 0.957s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:45 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f Jul 03 12:58:45 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Flow 'volume_create_manager' (79874802-72af-4497-a44c-5fd590a4f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab20e45-dd62-41bc-98b7-27a004f1ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab20e45-dd62-41bc-98b7-27a004f1ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2096574355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58eb9e4f-4a39-464d-83b9-dd1319f0d211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bf9f13a0d24075a8779a32d803251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:46Z,use_quota=True,user_id='3f8aa4078ca0482ba5eea88691ec7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ca2c05-f97e-4d42-87b8-32381b52d2cb),volume_type_id=35ca2c05-f97e-4d42-87b8-32381b52d2cb)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7201ce14-de01-4713-afb2-5057b70d5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7201ce14-de01-4713-afb2-5057b70d5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8d59e4-035c-49c3-a6b4-c40c3167404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8d59e4-035c-49c3-a6b4-c40c3167404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58eb9e4f-4a39-464d-83b9-dd1319f0d211', 'volume_name': 'volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79c4e94-05c1-47af-9592-b5aa7a534455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79c4e94-05c1-47af-9592-b5aa7a534455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895b4cd6-6492-4eec-8612-07ca26daeb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume 58eb9e4f-4a39-464d-83b9-dd1319f0d211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211', 'volume_size': 1} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:46 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c024ca3c-ac2a-46d1-a313-c4a069d25a0f" returned: 0 in 1.106s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Lock "cinder-quobyte-c024ca3c-ac2a-46d1-a313-c4a069d25a0f" released by "delete_volume" :: held 2.134s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Created reservations ['dd9c4bdf-f8ba-40fb-aee8-72be54a6efe5', 'e7594c9b-71e1-4380-ada6-5d40d8bb9e26', 'f031c5b2-90c1-4cd8-8088-e65ac94840c3', 'cd0b7a11-b90b-4fee-be6b-1dcf23d44bf9'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:47 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:58:47 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:47 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 1073741824" returned: 0 in 1.526s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Flow 'volume_create_manager' (e73c6a5c-699a-42ff-aa78-cc41d7ced562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f3105c-f8a8-4762-b2cf-5db29af459c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f3105c-f8a8-4762-b2cf-5db29af459c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-848073268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bf9f13a0d24075a8779a32d803251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:47Z,use_quota=True,user_id='3f8aa4078ca0482ba5eea88691ec7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed11bbe5-f1f2-4e9d-bd28-8e64c64514dd),volume_type_id=ed11bbe5-f1f2-4e9d-bd28-8e64c64514dd)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fdf5d5-12d4-4044-8db4-a1c78e3e97df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fdf5d5-12d4-4044-8db4-a1c78e3e97df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50116321-cf12-484a-b063-8b4364fedf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:47 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 Jul 03 12:58:47 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50116321-cf12-484a-b063-8b4364fedf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d', 'volume_name': 'volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d', 'volume_size': 1, 'image_id': '12662229-c0c0-4e22-8441-921de26133a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12662229-c0c0-4e22-8441-921de26133a7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--353579346', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59bf9f13a0d24075a8779a32d803251d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12662229-c0c0-4e22-8441-921de26133a7', 'created_at': datetime.datetime(2026, 7, 3, 10, 58, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12662229-c0c0-4e22-8441-921de26133a7/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c93f15-e61b-44ee-a8e6-b16ec94de0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c93f15-e61b-44ee-a8e6-b16ec94de0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d9bc8-d9a3-474b-b3e5-18a97d207e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d', 'volume_size': 1, 'image_id': '12662229-c0c0-4e22-8441-921de26133a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12662229-c0c0-4e22-8441-921de26133a7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--353579346', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59bf9f13a0d24075a8779a32d803251d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12662229-c0c0-4e22-8441-921de26133a7', 'created_at': datetime.datetime(2026, 7, 3, 10, 58, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12662229-c0c0-4e22-8441-921de26133a7/file', 'properties': {}}, 'image_service': } Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Trying to clone 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d from image 12662229-c0c0-4e22-8441-921de26133a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/12662229-c0c0-4e22-8441-921de26133a7', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 12:58:47 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.801s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:58:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Deleted volume successfully. Jul 03 12:58:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-98d741d6-7314-4f16-9ea5-0a6b9bd42acb tempest-VolumesActionsTest-1710539886 None] Lock "cinder-c024ca3c-ac2a-46d1-a313-c4a069d25a0f-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:58:48 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2096574355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58eb9e4f-4a39-464d-83b9-dd1319f0d211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bf9f13a0d24075a8779a32d803251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:46Z,use_quota=True,user_id='3f8aa4078ca0482ba5eea88691ec7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ca2c05-f97e-4d42-87b8-32381b52d2cb),volume_type_id=35ca2c05-f97e-4d42-87b8-32381b52d2cb)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Creating volume 58eb9e4f-4a39-464d-83b9-dd1319f0d211 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:48 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 1073741824 Jul 03 12:58:48 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e622ca9-3e6a-4d26-8f2d-a60bd831a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeac349f-a801-4eda-b7d5-779902668b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 (2e37c387-3df0-4f7c-a575-ecaf86e00bf8): created successfully Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeac349f-a801-4eda-b7d5-779902668b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Flow 'volume_create_manager' (98dba930-d0e9-45ff-8472-0c7814b1a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5616912e-1938-48af-b3a0-407a16ce1798 tempest-TestInstancesWithCinderVolumes-992354953 None] Created volume successfully. Jul 03 12:58:49 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 1073741824" returned: 0 in 1.054s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:49 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 Jul 03 12:58:49 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:50 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.736s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Creating offline snapshot b68a148e-0c63-497a-b396-73eef712e22d of volume 73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895b4cd6-6492-4eec-8612-07ca26daeb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58772433-07d9-4627-a17e-5465b53c6b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[124aa70b-b1cd-4a3a-9061-d6679492706d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 (58eb9e4f-4a39-464d-83b9-dd1319f0d211): created successfully Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58772433-07d9-4627-a17e-5465b53c6b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:58:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Flow 'volume_create_manager' (79874802-72af-4497-a44c-5fd590a4f129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:58:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3e40253d-134b-4fd7-ba1f-02f548108e55 tempest-TestInstancesWithCinderVolumes-992354953 None] Created volume successfully. Jul 03 12:58:50 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 12:58:50 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:51 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:51 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d 1G Jul 03 12:58:51 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:51 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD, size 20.69 MB, duration 4.27 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 12:58:51 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Image download 20.69 MB at 4.85 MB/s Jul 03 12:58:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7543213-9f30-48bf-9cd5-28919ee68ed9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:52 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD Jul 03 12:58:52 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:52 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d 1G" returned: 0 in 1.160s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:52 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d Jul 03 12:58:52 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:52 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:52 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Temporary image 12662229-c0c0-4e22-8441-921de26133a7 is fetched for user 3f8aa4078ca0482ba5eea88691ec7930. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 12:58:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1335b7-a8c0-4160-afac-7db2e8248978]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:53 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD Jul 03 12:58:53 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:53 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d" returned: 0 in 0.924s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:53 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d is being set with open permissions: ugo+rw Jul 03 12:58:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:53 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d Jul 03 12:58:53 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:53 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:54 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:54 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info Jul 03 12:58:54 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:54 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info" returned: 0 in 0.741s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info is being set with open permissions: ugo+rw Jul 03 12:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:54 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info Jul 03 12:58:54 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:55 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.info" returned: 0 in 0.733s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.471s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-848073268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bf9f13a0d24075a8779a32d803251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:47Z,use_quota=True,user_id='3f8aa4078ca0482ba5eea88691ec7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed11bbe5-f1f2-4e9d-bd28-8e64c64514dd),volume_type_id=ed11bbe5-f1f2-4e9d-bd28-8e64c64514dd)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Creating volume 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:58:55 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:55 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d 1073741824 Jul 03 12:58:55 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-84b388a7-63ee-4911-9eee-57b5e3dbb141 tempest-TestStampPattern-165122556 None] Create snapshot completed successfully Jul 03 12:58:56 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d 1073741824" returned: 0 in 1.338s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:57 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 12:58:57 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:57 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:58:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:58:57 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Attempting download of 12662229-c0c0-4e22-8441-921de26133a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/12662229-c0c0-4e22-8441-921de26133a7', 'metadata': {}}])) to volume 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 12:58:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af35d09-ec7b-45df-9c54-48292fbbef5c]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:57 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6 Jul 03 12:58:57 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:58 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6" returned: 0 in 0.934s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:59 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6 Jul 03 12:58:59 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:58:59 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 03 12:58:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6" returned: 1 in 0.953s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:58:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12662229-c0c0-4e22-8441-921de26133a7_z_h9j2i6' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:58:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9ea71-65c9-44dc-93c5-d703b29df613]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:58:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:58:59 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD Jul 03 12:58:59 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:00 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:00 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] 12662229-c0c0-4e22-8441-921de26133a7 was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 12:59:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:00 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 12:59:00 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:02 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:59:02 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Flow 'volume_create_manager' (e972326d-f0a1-40b2-b41f-a8d59e57066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6f7b15-7aa7-4e90-872d-5dad8b7a6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6f7b15-7aa7-4e90-872d-5dad8b7a6014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1425397433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593de6ea-9990-4ec8-b535-8fcc9fa24ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10aba3f345543d8ac15d57d091de8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:02Z,use_quota=True,user_id='65a18b6c37a940008678de9ba32b5477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8127bd8-962b-4250-808a-777108eed3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8127bd8-962b-4250-808a-777108eed3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda663f7-5930-4aca-9551-c08ddfa9e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda663f7-5930-4aca-9551-c08ddfa9e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593de6ea-9990-4ec8-b535-8fcc9fa24ece', 'volume_name': 'volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94585439-ce50-43e3-a3b8-513481790e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94585439-ce50-43e3-a3b8-513481790e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e142d40a-661a-4f6e-8a3e-4e80cb82f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Volume 593de6ea-9990-4ec8-b535-8fcc9fa24ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece', 'volume_size': 1} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1425397433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593de6ea-9990-4ec8-b535-8fcc9fa24ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10aba3f345543d8ac15d57d091de8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:02Z,use_quota=True,user_id='65a18b6c37a940008678de9ba32b5477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Creating volume 593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:59:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:02 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece 1073741824 Jul 03 12:59:02 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:02 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.958s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:59:03 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 0 in 2.558s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:03 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12662229-c0c0-4e22-8441-921de26133a7_g3e1w2xudevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:59:03 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Converted 112.00 MB image at 43.77 MB/s Jul 03 12:59:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:03 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d 1G Jul 03 12:59:03 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:03 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece 1073741824" returned: 0 in 1.136s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:03 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece Jul 03 12:59:03 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:04 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d 1G" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98854c-a0c3-4572-ad96-d5e993989cbd]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:04 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e142d40a-661a-4f6e-8a3e-4e80cb82f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2f95e1-8b1c-4a72-9307-0d226f005765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:04 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 12:59:04 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Volume volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece (593de6ea-9990-4ec8-b535-8fcc9fa24ece): created successfully Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2f95e1-8b1c-4a72-9307-0d226f005765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Flow 'volume_create_manager' (e972326d-f0a1-40b2-b41f-a8d59e57066f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4d3a85fa-a0ec-487b-8f6d-4b6edd8074da tempest-VolumesDeleteCascade-1706203687 None] Created volume successfully. Jul 03 12:59:05 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 0 in 0.845s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:05 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 12:59:05 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Creating offline snapshot fbfce7b2-c3af-4796-bad6-62a25950b90f of volume 593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f46f7f-b2f4-465e-82ed-969cb1a0ed87]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:05 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece Jul 03 12:59:05 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:05 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 1 in 0.934s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Downloaded image 12662229-c0c0-4e22-8441-921de26133a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/12662229-c0c0-4e22-8441-921de26133a7', 'metadata': {}}])) to volume 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Temporary image 12662229-c0c0-4e22-8441-921de26133a7 for user 3f8aa4078ca0482ba5eea88691ec7930 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Marking volume 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Copying metadata from image 12662229-c0c0-4e22-8441-921de26133a7 to 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 12:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Creating volume glance metadata for volume 34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d backed by image 12662229-c0c0-4e22-8441-921de26133a7 with: {'image_id': '12662229-c0c0-4e22-8441-921de26133a7', 'image_name': 'tempest-scenario-img--353579346', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d9bc8-d9a3-474b-b3e5-18a97d207e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d', 'volume_size': 1, 'image_id': '12662229-c0c0-4e22-8441-921de26133a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12662229-c0c0-4e22-8441-921de26133a7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--353579346', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59bf9f13a0d24075a8779a32d803251d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12662229-c0c0-4e22-8441-921de26133a7', 'created_at': datetime.datetime(2026, 7, 3, 10, 58, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12662229-c0c0-4e22-8441-921de26133a7/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f90075e-06f9-41f7-a779-cfae372aeb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Volume volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d (34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d): created successfully Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f90075e-06f9-41f7-a779-cfae372aeb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Flow 'volume_create_manager' (e73c6a5c-699a-42ff-aa78-cc41d7ced562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-586bab06-a007-426c-a43f-abbbb574d6d7 tempest-TestInstancesWithCinderVolumes-992354953 None] Created volume successfully. Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Flow 'volume_create_manager' (245ec794-0003-442f-86b3-25b89ade5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60506350-c650-473e-97d5-a0287f9997c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60506350-c650-473e-97d5-a0287f9997c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1610074098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f186a79-1f70-4728-89ef-d8ffa781ada3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843f71cd0a4c4324ba086b1fe3c047c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b68a148e-0c63-497a-b396-73eef712e22d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:06Z,use_quota=True,user_id='a7b33cf9ad99465a9303b788ddecbc1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7adb49-b0a4-4333-bda3-ec7f6a99273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7adb49-b0a4-4333-bda3-ec7f6a99273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c832182-85c6-4d61-9d3c-6dc96f156de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c832182-85c6-4d61-9d3c-6dc96f156de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f186a79-1f70-4728-89ef-d8ffa781ada3', 'volume_name': 'volume-3f186a79-1f70-4728-89ef-d8ffa781ada3', 'volume_size': 1, 'snapshot_id': 'b68a148e-0c63-497a-b396-73eef712e22d'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f22ad-bac1-4461-8e13-1d60948d2d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f22ad-bac1-4461-8e13-1d60948d2d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7d02f6-c572-4941-8975-89040461e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Volume 3f186a79-1f70-4728-89ef-d8ffa781ada3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f186a79-1f70-4728-89ef-d8ffa781ada3', 'volume_size': 1, 'snapshot_id': 'b68a148e-0c63-497a-b396-73eef712e22d'} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:06 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece" returned: 0 in 1.033s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:06 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f 1G Jul 03 12:59:06 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:07 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f 1G" returned: 0 in 1.335s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:08 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:08 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:08 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f is being set with open permissions: ugo+rw Jul 03 12:59:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:08 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:08 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:09 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 0.778s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:09 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info Jul 03 12:59:09 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:10 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:10 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info is being set with open permissions: ugo+rw Jul 03 12:59:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:10 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info Jul 03 12:59:10 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:11 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.info" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.849s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.876s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-quobyte-b68a148e-0c63-497a-b396-73eef712e22d-3f186a79-1f70-4728-89ef-d8ffa781ada3" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-b68a148e-0c63-497a-b396-73eef712e22d-3f186a79-1f70-4728-89ef-d8ffa781ada3" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Creating volume 3f186a79-1f70-4728-89ef-d8ffa781ada3 from snapshot b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-quobyte-3f186a79-1f70-4728-89ef-d8ffa781ada3" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8d344a07-57c0-4cf2-bdf0-e07075b3a70a tempest-VolumesDeleteCascade-1706203687 None] Create snapshot completed successfully Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-3f186a79-1f70-4728-89ef-d8ffa781ada3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] snapshot: b68a148e-0c63-497a-b396-73eef712e22d, volume: 3f186a79-1f70-4728-89ef-d8ffa781ada3, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c63c0e-a775-46b8-8d08-d429cb6fe31c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:11 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d Jul 03 12:59:11 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:12 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d" returned: 0 in 0.954s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f7db9-9a55-4359-8797-dc3d74a54d12]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:12 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 12:59:12 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:13 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 1.102s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:13 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:59:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:13 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 Jul 03 12:59:13 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:20 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3" returned: 0 in 7.159s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f40233d-a626-4a17-80b3-85d7608c97bc]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:20 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 12:59:20 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 0.989s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:21 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:59:21 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Converted 1024.00 MB image at 143.01 MB/s Jul 03 12:59:21 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 is being set with open permissions: ugo+rw Jul 03 12:59:21 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:21 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 Jul 03 12:59:21 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:22 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-3f186a79-1f70-4728-89ef-d8ffa781ada3" released by "_copy_volume_from_snapshot" :: held 11.091s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-b68a148e-0c63-497a-b396-73eef712e22d-3f186a79-1f70-4728-89ef-d8ffa781ada3" released by "_create_volume_from_snapshot" :: held 11.134s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.174s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.480s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Creating offline snapshot 15a7a862-e7b3-4360-8350-49e22d8396c9 of volume 593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7d02f6-c572-4941-8975-89040461e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f186a79-1f70-4728-89ef-d8ffa781ada3', 'volume_size': 1, 'snapshot_id': 'b68a148e-0c63-497a-b396-73eef712e22d'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52a75f6-98fc-42ce-a449-db3bc209c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b33b1b-3d60-4054-be03-68d301c2d10c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:22 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Volume volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 (3f186a79-1f70-4728-89ef-d8ffa781ada3): created successfully Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52a75f6-98fc-42ce-a449-db3bc209c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Flow 'volume_create_manager' (245ec794-0003-442f-86b3-25b89ade5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-19c36e0e-af51-455f-b7da-bf3bffa9146a tempest-TestStampPattern-165122556 None] Created volume successfully. Jul 03 12:59:22 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:22 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:23 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 1.111s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:23 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 1G Jul 03 12:59:23 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:25 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 1G" returned: 0 in 1.217s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:25 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 Jul 03 12:59:25 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:25 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:25 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 is being set with open permissions: ugo+rw Jul 03 12:59:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:25 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 Jul 03 12:59:25 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:26 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=59,cinder:INSERT=25,cinder:UPDATE=65,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:INSERT=16,cinder:UPDATE=59,cinder:DELETE=8,cinder:SELECT=63 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.780s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3db86aad-63e6-4c72-9723-36e1cab15a18 tempest-VolumesDeleteCascade-1706203687 None] Create snapshot completed successfully Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b4bd1e-b0cb-4f64-bab9-63a50d474001]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:26 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 12:59:26 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-593de6ea-9990-4ec8-b535-8fcc9fa24ece-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-593de6ea-9990-4ec8-b535-8fcc9fa24ece-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Performing cascade delete. {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-15a7a862-e7b3-4360-8350-49e22d8396c9-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-15a7a862-e7b3-4360-8350-49e22d8396c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-15a7a862-e7b3-4360-8350-49e22d8396c9" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-15a7a862-e7b3-4360-8350-49e22d8396c9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Deleting offline snapshot 15a7a862-e7b3-4360-8350-49e22d8396c9 of volume 593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] snapshot_file for this snap is: volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee499f-3bc7-43e7-8796-9548a14b73af]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:27 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 Jul 03 12:59:27 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:28 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 0 in 1.359s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:28 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 12:59:28 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:28 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9" returned: 0 in 1.235s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:59:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f615f071-bbba-4d7e-b6ef-99e09f926bf2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:29 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:29 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:29 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 1 in 1.069s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.506s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cde3748-0f96-4f93-9e94-37b2f6384db1', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 12:59:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-76bef493-d0bc-4f21-845b-1322728b2883 req-350d425c-dc42-4b31-a327-4af02c39a0d3 tempest-TestInstancesWithCinderVolumes-992354953 None] attachment_update completed successfully. Jul 03 12:59:29 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 1.153s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:30 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 Jul 03 12:59:30 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:31 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9" returned: 0 in 1.066s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:31 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9 Jul 03 12:59:31 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:31 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.15a7a862-e7b3-4360-8350-49e22d8396c9" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-15a7a862-e7b3-4360-8350-49e22d8396c9" released by "_delete_snapshot" :: held 4.410s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" released by "delete_snapshot" :: held 4.453s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Created reservations ['d9d805b5-7935-4bee-964f-abce053c750f', 'eb514474-1e50-4ac2-972f-63bb3d187373', 'ea67880f-5236-4a69-8fd6-27c180331263', '8d856499-fc90-471f-83f0-067b3051d7c1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:59:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Delete snapshot completed successfully. Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-15a7a862-e7b3-4360-8350-49e22d8396c9-delete_snapshot" released by "delete_snapshot" :: held 4.687s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-fbfce7b2-c3af-4796-bad6-62a25950b90f-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-fbfce7b2-c3af-4796-bad6-62a25950b90f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-fbfce7b2-c3af-4796-bad6-62a25950b90f" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-fbfce7b2-c3af-4796-bad6-62a25950b90f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Deleting offline snapshot fbfce7b2-c3af-4796-bad6-62a25950b90f of volume 593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] snapshot_file for this snap is: volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[77838647-251c-4a50-a86c-815b41ebaea9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:32 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:32 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:33 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 1.007s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:59:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37693be-2417-4d73-8d0c-b4c071200fe6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:33 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece Jul 03 12:59:33 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:34 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece" returned: 0 in 0.932s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:34 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:34 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:35 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 1.258s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:35 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f Jul 03 12:59:35 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:36 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece.fbfce7b2-c3af-4796-bad6-62a25950b90f" returned: 0 in 1.193s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-fbfce7b2-c3af-4796-bad6-62a25950b90f" released by "_delete_snapshot" :: held 4.535s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" released by "delete_snapshot" :: held 4.566s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Created reservations ['0d8ce5ba-70a0-4ba9-aa2a-64898ab39802', 'cf282383-85b7-4c8e-88b7-216470a230b3', 'd8205d2a-a8a7-40fa-945b-43271fe2fca4', 'a0cec1dd-76a9-4179-bb61-3edf8fee2c4c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:59:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Delete snapshot completed successfully. Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-fbfce7b2-c3af-4796-bad6-62a25950b90f-delete_snapshot" released by "delete_snapshot" :: held 4.753s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Snapshots deleted, issuing volume delete {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2ea8d-5e45-4c96-a665-75f7e6282996]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:37 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece Jul 03 12:59:37 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:38 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece" returned: 0 in 1.151s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:38 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece Jul 03 12:59:38 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:38 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-593de6ea-9990-4ec8-b535-8fcc9fa24ece" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-593de6ea-9990-4ec8-b535-8fcc9fa24ece" released by "delete_volume" :: held 2.023s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Created reservations ['c69d560b-d870-469e-a672-b93aea68a940', '8e43a214-ff2b-475b-846d-1e5a8a510eac', '761081d3-cc75-4e90-8c23-0ecbd2cb1bb0', 'eb4f0423-036b-49fc-b43a-63604614336e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 12:59:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:39 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 12:59:39 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:40 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 12:59:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Deleted volume successfully. Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f110f7da-7ccc-48b7-8ad0-71347bf8d255 tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-593de6ea-9990-4ec8-b535-8fcc9fa24ece-delete_volume" released by "delete_volume" :: held 12.864s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Flow 'volume_create_manager' (59f33c1b-46e3-4f30-a698-118732759b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a0981f-f594-4bb9-b6a1-936bdd22d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a0981f-f594-4bb9-b6a1-936bdd22d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-543802625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd93662-9ae2-44e7-b2ac-a000b649a62f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10aba3f345543d8ac15d57d091de8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:41Z,use_quota=True,user_id='65a18b6c37a940008678de9ba32b5477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b48a1c-23ee-4735-ae78-117036138749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b48a1c-23ee-4735-ae78-117036138749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f7bfe3-6015-41ca-9adb-99a6432e3fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f7bfe3-6015-41ca-9adb-99a6432e3fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd93662-9ae2-44e7-b2ac-a000b649a62f', 'volume_name': 'volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce08b23-fb09-4e10-a6c9-1cc1f7c5131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce08b23-fb09-4e10-a6c9-1cc1f7c5131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adff3726-58d7-4fa6-a34c-2eb2a47202e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Volume 0fd93662-9ae2-44e7-b2ac-a000b649a62f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f', 'volume_size': 1} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-543802625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd93662-9ae2-44e7-b2ac-a000b649a62f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10aba3f345543d8ac15d57d091de8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:41Z,use_quota=True,user_id='65a18b6c37a940008678de9ba32b5477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Creating volume 0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:59:40 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 12:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:41 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f 1073741824 Jul 03 12:59:41 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:42 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f 1073741824" returned: 0 in 1.054s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:42 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 12:59:42 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:42 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adff3726-58d7-4fa6-a34c-2eb2a47202e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39d1cf2-c8ef-4276-92fa-c2dc73507cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Volume volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f (0fd93662-9ae2-44e7-b2ac-a000b649a62f): created successfully Jul 03 12:59:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39d1cf2-c8ef-4276-92fa-c2dc73507cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Flow 'volume_create_manager' (59f33c1b-46e3-4f30-a698-118732759b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-930cc74f-36d9-45af-8eea-02b7c3180629 tempest-VolumesDeleteCascade-1706203687 None] Created volume successfully. Jul 03 12:59:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Creating offline snapshot 81e37e2d-5d03-4d4c-a03a-887e6ee8566e of volume 0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 12:59:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575ae51-85f1-45f6-bad8-825f12bb4ffa]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:44 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 12:59:44 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:45 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 1.063s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:45 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e 1G Jul 03 12:59:45 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:46 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e 1G" returned: 0 in 1.022s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:46 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e Jul 03 12:59:46 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:47 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e" returned: 0 in 0.981s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e is being set with open permissions: ugo+rw Jul 03 12:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:47 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e Jul 03 12:59:47 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:48 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:48 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info Jul 03 12:59:48 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:48 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:48 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info is being set with open permissions: ugo+rw Jul 03 12:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:48 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info Jul 03 12:59:49 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:49 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.info" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.530s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cdfd36a2-353c-4f95-ae77-dd41b67997a4 tempest-VolumesDeleteCascade-1706203687 None] Create snapshot completed successfully Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Flow 'volume_create_manager' (cb797862-da89-43bf-8bd4-2c75e769e503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2b883b-a921-4b15-ba45-bd73ed3aa93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2b883b-a921-4b15-ba45-bd73ed3aa93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-954990571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b21d0f-10a7-443f-a109-b0e4d4880c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10aba3f345543d8ac15d57d091de8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81e37e2d-5d03-4d4c-a03a-887e6ee8566e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:51Z,use_quota=True,user_id='65a18b6c37a940008678de9ba32b5477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b80245-3134-40b2-b95b-d621db2db04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b80245-3134-40b2-b95b-d621db2db04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2755e04-b1dd-4636-911b-a0bf8e5574dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2755e04-b1dd-4636-911b-a0bf8e5574dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33b21d0f-10a7-443f-a109-b0e4d4880c48', 'volume_name': 'volume-33b21d0f-10a7-443f-a109-b0e4d4880c48', 'volume_size': 1, 'snapshot_id': '81e37e2d-5d03-4d4c-a03a-887e6ee8566e'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a430743-5ce7-47bd-b2e4-c0379ef97f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a430743-5ce7-47bd-b2e4-c0379ef97f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca060b23-7602-41a1-af7a-06bf60735a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 12:59:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Volume 33b21d0f-10a7-443f-a109-b0e4d4880c48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33b21d0f-10a7-443f-a109-b0e4d4880c48', 'volume_size': 1, 'snapshot_id': '81e37e2d-5d03-4d4c-a03a-887e6ee8566e'} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-81e37e2d-5d03-4d4c-a03a-887e6ee8566e-33b21d0f-10a7-443f-a109-b0e4d4880c48" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-81e37e2d-5d03-4d4c-a03a-887e6ee8566e-33b21d0f-10a7-443f-a109-b0e4d4880c48" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Creating volume 33b21d0f-10a7-443f-a109-b0e4d4880c48 from snapshot 81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-33b21d0f-10a7-443f-a109-b0e4d4880c48" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-33b21d0f-10a7-443f-a109-b0e4d4880c48" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] snapshot: 81e37e2d-5d03-4d4c-a03a-887e6ee8566e, volume: 33b21d0f-10a7-443f-a109-b0e4d4880c48, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f0ad1-2e23-4955-93be-46d058feda41]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:51 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e Jul 03 12:59:51 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:52 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 12:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 12:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 12:59:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921b8ea-4095-46fb-944e-e8d5de802f4d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:52 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 12:59:52 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:53 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:53 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 12:59:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:53 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 Jul 03 12:59:53 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:58 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48" returned: 0 in 4.963s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[43122c24-0ddf-474b-bee8-edfff64f8902]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 12:59:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:58 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 12:59:58 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 12:59:59 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jul 03 12:59:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 1.094s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 12:59:59 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 12:59:59 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Converted 1024.00 MB image at 206.30 MB/s Jul 03 12:59:59 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 is being set with open permissions: ugo+rw Jul 03 12:59:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 12:59:59 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 Jul 03 12:59:59 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:00 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-33b21d0f-10a7-443f-a109-b0e4d4880c48" released by "_copy_volume_from_snapshot" :: held 8.702s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-81e37e2d-5d03-4d4c-a03a-887e6ee8566e-33b21d0f-10a7-443f-a109-b0e4d4880c48" released by "_create_volume_from_snapshot" :: held 8.740s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.760s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca060b23-7602-41a1-af7a-06bf60735a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b21d0f-10a7-443f-a109-b0e4d4880c48', 'volume_size': 1, 'snapshot_id': '81e37e2d-5d03-4d4c-a03a-887e6ee8566e'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327796cd-3dc9-4978-9858-480e3b925fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Volume volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 (33b21d0f-10a7-443f-a109-b0e4d4880c48): created successfully Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327796cd-3dc9-4978-9858-480e3b925fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Flow 'volume_create_manager' (cb797862-da89-43bf-8bd4-2c75e769e503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7b01aef9-6e5c-4a99-be21-475ae3bc0d3c tempest-VolumesDeleteCascade-1706203687 None] Created volume successfully. Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-0fd93662-9ae2-44e7-b2ac-a000b649a62f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-0fd93662-9ae2-44e7-b2ac-a000b649a62f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Performing cascade delete. {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-81e37e2d-5d03-4d4c-a03a-887e6ee8566e-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-81e37e2d-5d03-4d4c-a03a-887e6ee8566e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-0fd93662-9ae2-44e7-b2ac-a000b649a62f" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-0fd93662-9ae2-44e7-b2ac-a000b649a62f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-81e37e2d-5d03-4d4c-a03a-887e6ee8566e" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-81e37e2d-5d03-4d4c-a03a-887e6ee8566e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Deleting offline snapshot 81e37e2d-5d03-4d4c-a03a-887e6ee8566e of volume 0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] snapshot_file for this snap is: volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e54531-a4d5-48f4-aefe-7afec850534e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:01 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e Jul 03 13:00:01 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:02 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:02 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:02 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e" returned: 0 in 0.947s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:00:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[089701b2-e0e0-41fa-84f2-49530915a9e9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:02 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 13:00:02 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:02 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:03 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 1.043s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:03 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e Jul 03 13:00:03 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:04 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e" returned: 0 in 0.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:04 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e Jul 03 13:00:04 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:05 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f.81e37e2d-5d03-4d4c-a03a-887e6ee8566e" returned: 0 in 0.678s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-81e37e2d-5d03-4d4c-a03a-887e6ee8566e" released by "_delete_snapshot" :: held 3.641s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-0fd93662-9ae2-44e7-b2ac-a000b649a62f" released by "delete_snapshot" :: held 3.666s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Created reservations ['f92c8d6a-dbe0-4353-99d0-c61e910ed262', '8f6c3be3-2407-4f8e-ab3d-6b5b5ddd5dcf', '18d2ba1b-aced-45e2-8e08-c4888e5507b4', '12982b6c-1383-416c-8bd4-204cba91fdee'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Delete snapshot completed successfully. Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-81e37e2d-5d03-4d4c-a03a-887e6ee8566e-delete_snapshot" released by "delete_snapshot" :: held 3.830s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Snapshots deleted, issuing volume delete {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-0fd93662-9ae2-44e7-b2ac-a000b649a62f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-0fd93662-9ae2-44e7-b2ac-a000b649a62f" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e53d047-a861-4818-8e9b-30d0b74a350b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:05 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 13:00:05 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:06 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:06 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f Jul 03 13:00:06 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:07 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0fd93662-9ae2-44e7-b2ac-a000b649a62f" returned: 0 in 0.839s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-0fd93662-9ae2-44e7-b2ac-a000b649a62f" released by "delete_volume" :: held 1.816s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Created reservations ['10672407-b1a5-43d9-9899-e4c12003498f', 'a5660ca0-aa86-45fc-8e10-ba564e4e1633', 'd28c6c23-8d70-48c2-88e0-72380f5f826f', '05098364-8bed-4822-a591-cbeef3e97012'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:07 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:07 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:08 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Deleted volume successfully. Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-779ade02-4e13-480d-b596-23e8067ecede tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-0fd93662-9ae2-44e7-b2ac-a000b649a62f-delete_volume" released by "delete_volume" :: held 6.733s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-33b21d0f-10a7-443f-a109-b0e4d4880c48-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-33b21d0f-10a7-443f-a109-b0e4d4880c48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "cinder-quobyte-33b21d0f-10a7-443f-a109-b0e4d4880c48" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-33b21d0f-10a7-443f-a109-b0e4d4880c48" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4051c0-c562-4bf7-80b5-32d1d0b97480]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:08 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 Jul 03 13:00:08 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be6652-f8fb-4c02-8d28-c18566d823a2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:09 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48" returned: 0 in 1.046s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:09 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48 Jul 03 13:00:09 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:09 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 Jul 03 13:00:09 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:10 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b21d0f-10a7-443f-a109-b0e4d4880c48" returned: 0 in 0.921s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-quobyte-33b21d0f-10a7-443f-a109-b0e4d4880c48" released by "delete_volume" :: held 2.024s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:10 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3" returned: 0 in 1.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.052s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Created reservations ['468b0933-e4d2-4543-8cf0-f0f7ddcd50cf', '9fd3a639-864c-42e8-b729-dfe91ca13ffe', '1b59fb05-927d-42ec-9323-52198c5b9572', '85d725ca-9ba3-4949-8fe6-005fe0d78a56'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-3f186a79-1f70-4728-89ef-d8ffa781ada3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11cff2d7-9c6a-4e9e-b6ab-3047da8e1724', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:00:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b9efb061-57f7-4387-8cea-55582e86fd5c req-f3c84a47-bc48-4248-a98c-1fb4cf77591a tempest-TestStampPattern-165122556 None] attachment_update completed successfully. Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:10 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:10 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c501ff-e30d-44bb-83e7-5a9b0f5ab6c7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:10 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 Jul 03 13:00:10 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:11 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.761s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:11 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Deleted volume successfully. Jul 03 13:00:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f6b3089d-c697-4ad2-bcff-d5d07fb3fb8a tempest-VolumesDeleteCascade-1706203687 None] Lock "cinder-33b21d0f-10a7-443f-a109-b0e4d4880c48-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:11 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" returned: 0 in 1.126s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.154s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3b94b99-3951-4ca5-b908-8b8c931aa8b1', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:00:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b21cb81f-c232-4678-b8a7-8a7e639e8970 req-825531b1-6c8e-4303-9b8b-9c0d5c23215e tempest-TestInstancesWithCinderVolumes-992354953 None] attachment_update completed successfully. Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Flow 'volume_create_manager' (9460e3b9-6dd0-410e-86aa-34dc24b087b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0533fc33-4ad7-4b01-9377-1bf18c9974c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0533fc33-4ad7-4b01-9377-1bf18c9974c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-744333757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cf02e9-9be6-4a24-8494-94861cd27197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca55b5644b046b5b73f574512746e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:15Z,use_quota=True,user_id='a3249b96f4ee42e0ab666a1425d252f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eefcf2-fe54-41d7-8f80-19b9ed94c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eefcf2-fe54-41d7-8f80-19b9ed94c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5796f65-1e38-43f8-bb8d-40e85ca89497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5796f65-1e38-43f8-bb8d-40e85ca89497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cf02e9-9be6-4a24-8494-94861cd27197', 'volume_name': 'volume-17cf02e9-9be6-4a24-8494-94861cd27197', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058ede8c-7739-45c2-adf4-cf7dedd3818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058ede8c-7739-45c2-adf4-cf7dedd3818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533b2e3e-8574-4e2a-a9ff-669ae4350ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Volume 17cf02e9-9be6-4a24-8494-94861cd27197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cf02e9-9be6-4a24-8494-94861cd27197', 'volume_size': 1} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-744333757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cf02e9-9be6-4a24-8494-94861cd27197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca55b5644b046b5b73f574512746e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:15Z,use_quota=True,user_id='a3249b96f4ee42e0ab666a1425d252f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Creating volume 17cf02e9-9be6-4a24-8494-94861cd27197 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:00:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:15 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 1073741824 Jul 03 13:00:15 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:16 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 1073741824" returned: 0 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:16 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 Jul 03 13:00:16 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:17 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197" returned: 0 in 0.691s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533b2e3e-8574-4e2a-a9ff-669ae4350ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cf02e9-9be6-4a24-8494-94861cd27197', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f356156-452b-4038-a54e-66a258bfa78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Volume volume-17cf02e9-9be6-4a24-8494-94861cd27197 (17cf02e9-9be6-4a24-8494-94861cd27197): created successfully Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f356156-452b-4038-a54e-66a258bfa78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Flow 'volume_create_manager' (9460e3b9-6dd0-410e-86aa-34dc24b087b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e97f8cb8-9d7f-4628-b8a7-c3a88e318f5a tempest-VolumesMetadataTest-245806917 None] Created volume successfully. Jul 03 13:00:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-85db83a0-aec5-41cf-a491-6d6baf20bdb5 req-4b6d7690-9403-401f-9299-5ec5ba508c5e tempest-TestStampPattern-165122556 None] Terminate volume connection completed successfully. Jul 03 13:00:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-85db83a0-aec5-41cf-a491-6d6baf20bdb5 req-4b6d7690-9403-401f-9299-5ec5ba508c5e tempest-TestStampPattern-165122556 None] Deleting attachment 11cff2d7-9c6a-4e9e-b6ab-3047da8e1724. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:00:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Acquiring lock "cinder-17cf02e9-9be6-4a24-8494-94861cd27197-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Lock "cinder-17cf02e9-9be6-4a24-8494-94861cd27197-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Acquiring lock "cinder-quobyte-17cf02e9-9be6-4a24-8494-94861cd27197" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Lock "cinder-quobyte-17cf02e9-9be6-4a24-8494-94861cd27197" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb906feb-2e7d-4d60-8c08-4e7771c08a79]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:18 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 Jul 03 13:00:18 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:19 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:19 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197 Jul 03 13:00:19 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:20 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-17cf02e9-9be6-4a24-8494-94861cd27197" returned: 0 in 0.819s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Lock "cinder-quobyte-17cf02e9-9be6-4a24-8494-94861cd27197" released by "delete_volume" :: held 1.763s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Created reservations ['93e00b91-01a1-479e-9e71-5472cb342073', 'f3b41327-ddf4-427a-b120-38cc05d13c84', '87949256-9600-4f83-9531-654e067b68c3', 'cd612a4a-09b5-407b-8a32-c16866da32ad'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:20 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:20 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8133c81-38d6-442c-996e-83be340fd138]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:20 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 Jul 03 13:00:20 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:21 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.153s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:21 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Deleted volume successfully. Jul 03 13:00:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d84c3ffc-7704-4588-985e-054611dc9b3c tempest-VolumesMetadataTest-245806917 None] Lock "cinder-17cf02e9-9be6-4a24-8494-94861cd27197-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:21 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211" returned: 0 in 1.304s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.380s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '277cc02d-798d-4108-9d72-8c0e2dea92aa', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:00:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-516b080b-776a-438c-95ff-ba346a1118bc req-4a248e3f-c3af-49e7-b6dd-5a48d42c36ec tempest-TestInstancesWithCinderVolumes-992354953 None] attachment_update completed successfully. Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=70,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=68,cinder:UPDATE=64,cinder:DELETE=3,cinder:INSERT=15 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Flow 'volume_create_manager' (e6731de9-65b5-45e3-8958-26b714272398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee1c54-fa04-4a2b-9236-1aca6838a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee1c54-fa04-4a2b-9236-1aca6838a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1348897976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328f5441-f574-41cd-ba8d-6c34af35e93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47790fe0e6b14e7ab2e09b337404e711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:27Z,use_quota=True,user_id='85f7991e13674806935129ee9f7f66e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54332ee8-afeb-4357-b050-d1d8cc9753cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54332ee8-afeb-4357-b050-d1d8cc9753cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26e591e-bc92-4e82-a5cd-b3c7c7339d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26e591e-bc92-4e82-a5cd-b3c7c7339d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328f5441-f574-41cd-ba8d-6c34af35e93f', 'volume_name': 'volume-328f5441-f574-41cd-ba8d-6c34af35e93f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20859fad-3fb0-4e10-9b83-f0dcf103bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20859fad-3fb0-4e10-9b83-f0dcf103bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc25fe85-a696-4ab8-975d-054176467711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Volume 328f5441-f574-41cd-ba8d-6c34af35e93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328f5441-f574-41cd-ba8d-6c34af35e93f', 'volume_size': 1} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1348897976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328f5441-f574-41cd-ba8d-6c34af35e93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47790fe0e6b14e7ab2e09b337404e711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:27Z,use_quota=True,user_id='85f7991e13674806935129ee9f7f66e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Creating volume 328f5441-f574-41cd-ba8d-6c34af35e93f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:00:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:27 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f 1073741824 Jul 03 13:00:27 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:28 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f 1073741824" returned: 0 in 1.051s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:28 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f Jul 03 13:00:28 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:29 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f" returned: 0 in 0.842s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc25fe85-a696-4ab8-975d-054176467711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328f5441-f574-41cd-ba8d-6c34af35e93f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59268aa4-701b-4833-9cfb-802b5edea558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Volume volume-328f5441-f574-41cd-ba8d-6c34af35e93f (328f5441-f574-41cd-ba8d-6c34af35e93f): created successfully Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59268aa4-701b-4833-9cfb-802b5edea558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Flow 'volume_create_manager' (e6731de9-65b5-45e3-8958-26b714272398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2ad7d4a5-44aa-4e21-862e-31a8a12e6f54 tempest-VolumesTransfersV357Test-431514358 None] Created volume successfully. Jul 03 13:00:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-3f186a79-1f70-4728-89ef-d8ffa781ada3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Lock "cinder-3f186a79-1f70-4728-89ef-d8ffa781ada3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-quobyte-3f186a79-1f70-4728-89ef-d8ffa781ada3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-3f186a79-1f70-4728-89ef-d8ffa781ada3" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5e18ba-c585-4321-a491-a8b26fd5437d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:30 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 Jul 03 13:00:30 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c667e0be-1c7f-4149-9e0a-7a5236c67dea tempest-VolumesTransfersV357Test-1797079996 None] Transfer volume completed successfully. Jul 03 13:00:31 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3" returned: 0 in 1.046s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:31 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3 Jul 03 13:00:31 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-2a2d600d-f98f-42aa-81e6-5938fa68d217 req-9f11d8fe-3896-4095-898c-a0c112b46692 tempest-TestInstancesWithCinderVolumes-992354953 None] Terminate volume connection completed successfully. Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-2a2d600d-f98f-42aa-81e6-5938fa68d217 req-9f11d8fe-3896-4095-898c-a0c112b46692 tempest-TestInstancesWithCinderVolumes-992354953 None] Deleting attachment e3b94b99-3951-4ca5-b908-8b8c931aa8b1. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:00:32 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f186a79-1f70-4728-89ef-d8ffa781ada3" returned: 0 in 0.929s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-3f186a79-1f70-4728-89ef-d8ffa781ada3" released by "delete_volume" :: held 2.022s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Created reservations ['a14effc1-a84e-4b63-88ae-1307b2a339d5', '586144f6-b12e-407b-8218-559d37d98fce', 'b7e22188-4aa1-4ba8-8d8f-cafb373a4541', 'd50db76a-57c1-4937-96b4-ddbe91df454f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Acquiring lock "cinder-328f5441-f574-41cd-ba8d-6c34af35e93f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-328f5441-f574-41cd-ba8d-6c34af35e93f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:32 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:32 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Acquiring lock "cinder-quobyte-328f5441-f574-41cd-ba8d-6c34af35e93f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-quobyte-328f5441-f574-41cd-ba8d-6c34af35e93f" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af64f21-9112-4a73-b9d6-aadcd5f86a5d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:32 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f Jul 03 13:00:32 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-b68a148e-0c63-497a-b396-73eef712e22d-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Lock "cinder-b68a148e-0c63-497a-b396-73eef712e22d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-quobyte-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-quobyte-b68a148e-0c63-497a-b396-73eef712e22d" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-b68a148e-0c63-497a-b396-73eef712e22d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Deleting offline snapshot b68a148e-0c63-497a-b396-73eef712e22d of volume 73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] snapshot_file for this snap is: volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab74b9a-a860-474c-97a5-c29a7fd9640e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:33 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d Jul 03 13:00:33 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:33 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Deleted volume successfully. Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b9fc68e8-b3e5-4850-8738-70a8e6026134 tempest-TestStampPattern-165122556 None] Lock "cinder-3f186a79-1f70-4728-89ef-d8ffa781ada3-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:33 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f" returned: 0 in 1.097s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:33 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f Jul 03 13:00:33 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:34 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d" returned: 0 in 1.006s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12fa916-fcc0-4aa2-99fa-30ca97dfb0db]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "cinder-2e37c387-3df0-4f7c-a575-ecaf86e00bf8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-2e37c387-3df0-4f7c-a575-ecaf86e00bf8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:34 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 13:00:34 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "cinder-quobyte-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-quobyte-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e370686-a002-46de-954a-1a66b8e7b093]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:34 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 Jul 03 13:00:34 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:34 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-328f5441-f574-41cd-ba8d-6c34af35e93f" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-quobyte-328f5441-f574-41cd-ba8d-6c34af35e93f" released by "delete_volume" :: held 2.029s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Created reservations ['1afe6550-dd8b-4608-851d-029f0e081454', '5a573ce3-cdd2-43ae-8d4f-3b29ca4527e8', 'b339fb1d-6d2c-4574-8b59-8a916274ee6a', '275adcbe-01b8-4b55-9614-e7e4ab4328cf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:34 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:34 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:35 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 1.119s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:35 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d Jul 03 13:00:35 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:35 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" returned: 0 in 1.117s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:35 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8 Jul 03 13:00:35 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:35 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Deleted volume successfully. Jul 03 13:00:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ada803f1-10b5-4798-b344-9dada91683aa tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-328f5441-f574-41cd-ba8d-6c34af35e93f-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:36 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d" returned: 0 in 1.119s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:36 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d Jul 03 13:00:36 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:36 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" returned: 0 in 1.000s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-quobyte-2e37c387-3df0-4f7c-a575-ecaf86e00bf8" released by "delete_volume" :: held 2.186s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:36 devstack cinder-volume[86966]: WARNING cinder.quota [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861874131-12046659 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861874131-12046659, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:00:36 devstack cinder-volume[86966]: WARNING cinder.quota [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861874131-12046659 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861874131-12046659, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Created reservations ['e7ae301f-c988-4fca-9d64-9ff343dd523a', '791d94d3-2546-43b7-90d4-45e57b99739c', '79c78aa2-36ba-465d-80f8-683041affcb5', '8616d162-6a11-4758-b774-13e45673be76'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Flow 'volume_create_manager' (3598f6e3-f035-4c9d-86da-bd2574a778eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f631680e-8b43-4f27-8c7e-e81d8bfce920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f631680e-8b43-4f27-8c7e-e81d8bfce920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429964222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12671fdb-1f2f-4b08-8315-b36146399670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47790fe0e6b14e7ab2e09b337404e711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:37Z,use_quota=True,user_id='85f7991e13674806935129ee9f7f66e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13af37c2-58e8-4f7e-a92d-d2bbbe960f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13af37c2-58e8-4f7e-a92d-d2bbbe960f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f541c51c-a229-4296-91d0-3a3e202c07aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f541c51c-a229-4296-91d0-3a3e202c07aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12671fdb-1f2f-4b08-8315-b36146399670', 'volume_name': 'volume-12671fdb-1f2f-4b08-8315-b36146399670', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f22c47-b6a4-4b57-bf84-8e9243c4792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f22c47-b6a4-4b57-bf84-8e9243c4792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e62afb-124d-48ea-972e-0cc232ad1390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Volume 12671fdb-1f2f-4b08-8315-b36146399670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12671fdb-1f2f-4b08-8315-b36146399670', 'volume_size': 1} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429964222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12671fdb-1f2f-4b08-8315-b36146399670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47790fe0e6b14e7ab2e09b337404e711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:37Z,use_quota=True,user_id='85f7991e13674806935129ee9f7f66e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Creating volume 12671fdb-1f2f-4b08-8315-b36146399670 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:00:36 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:36 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 1073741824 Jul 03 13:00:36 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:37 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:37 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:37 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af.b68a148e-0c63-497a-b396-73eef712e22d" returned: 0 in 0.878s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-b68a148e-0c63-497a-b396-73eef712e22d" released by "_delete_snapshot" :: held 4.294s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" released by "delete_snapshot" :: held 4.325s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Created reservations ['f4fd19ce-8ef9-408e-8f2b-2f1d7009cbe0', '0b1ac6eb-fe1e-42d1-b358-4e9785898c35', '1046e2be-7cb1-4011-8363-7f6b31bc3405', '90cca385-aa2a-44c4-8438-3f5d68abacea'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Delete snapshot completed successfully. Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-35bc79ac-b6f2-4d83-b334-e77cc02cbe44 tempest-TestStampPattern-165122556 None] Lock "cinder-b68a148e-0c63-497a-b396-73eef712e22d-delete_snapshot" released by "delete_snapshot" :: held 4.573s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:37 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.920s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Deleted volume successfully. Jul 03 13:00:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a0cf0f86-b500-4702-ae8f-0cca6e6ef02c tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-2e37c387-3df0-4f7c-a575-ecaf86e00bf8-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:38 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 1073741824" returned: 0 in 1.164s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:38 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 Jul 03 13:00:38 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:38 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e62afb-124d-48ea-972e-0cc232ad1390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12671fdb-1f2f-4b08-8315-b36146399670', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669d1bc1-021e-49ff-80c4-098996d15fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Volume volume-12671fdb-1f2f-4b08-8315-b36146399670 (12671fdb-1f2f-4b08-8315-b36146399670): created successfully Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669d1bc1-021e-49ff-80c4-098996d15fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Flow 'volume_create_manager' (3598f6e3-f035-4c9d-86da-bd2574a778eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6129fea2-1d08-4529-946c-94536a537114 tempest-VolumesTransfersV357Test-431514358 None] Created volume successfully. Jul 03 13:00:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-d3c910f3-55ef-4d54-9130-d6e1a9a4770e req-98948cac-8a40-4667-8efd-f933fa8d7c71 tempest-TestInstancesWithCinderVolumes-992354953 None] Terminate volume connection completed successfully. Jul 03 13:00:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-d3c910f3-55ef-4d54-9130-d6e1a9a4770e req-98948cac-8a40-4667-8efd-f933fa8d7c71 tempest-TestInstancesWithCinderVolumes-992354953 None] Deleting attachment 277cc02d-798d-4108-9d72-8c0e2dea92aa. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:00:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Acquiring lock "cinder-12671fdb-1f2f-4b08-8315-b36146399670-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-12671fdb-1f2f-4b08-8315-b36146399670-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Acquiring lock "cinder-quobyte-12671fdb-1f2f-4b08-8315-b36146399670" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-quobyte-12671fdb-1f2f-4b08-8315-b36146399670" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ab2707-2d7f-452a-8163-4f905f062f78]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:40 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 Jul 03 13:00:40 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:41 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670" returned: 0 in 1.218s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:41 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670 Jul 03 13:00:41 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "cinder-58eb9e4f-4a39-464d-83b9-dd1319f0d211-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-58eb9e4f-4a39-464d-83b9-dd1319f0d211-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "cinder-quobyte-58eb9e4f-4a39-464d-83b9-dd1319f0d211" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-quobyte-58eb9e4f-4a39-464d-83b9-dd1319f0d211" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[49268aff-8233-45db-9af7-5badf8282aa7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:42 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12671fdb-1f2f-4b08-8315-b36146399670" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:42 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 Jul 03 13:00:42 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-quobyte-12671fdb-1f2f-4b08-8315-b36146399670" released by "delete_volume" :: held 2.230s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Created reservations ['917533d8-d6ce-4023-a8b4-568681b6febf', '88ec6318-7507-478a-9ddc-662f5b465f02', '50d06416-8bff-4d10-863e-adff6d69b8e4', '1fef1888-532b-4f33-ac37-50267666e850'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:42 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:42 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:43 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211" returned: 0 in 1.370s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:43 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211 Jul 03 13:00:43 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:43 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.996s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Deleted volume successfully. Jul 03 13:00:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b0f449d-003d-4f83-8109-c194480e60c0 tempest-VolumesTransfersV357Test-912457543 None] Lock "cinder-12671fdb-1f2f-4b08-8315-b36146399670-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:44 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-58eb9e4f-4a39-464d-83b9-dd1319f0d211" returned: 0 in 1.041s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-quobyte-58eb9e4f-4a39-464d-83b9-dd1319f0d211" released by "delete_volume" :: held 2.492s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:44 devstack cinder-volume[86966]: WARNING cinder.quota [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192706873-510129122 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192706873-510129122, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:00:44 devstack cinder-volume[86966]: WARNING cinder.quota [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192706873-510129122 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1192706873-510129122, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Created reservations ['6b6d76f0-614c-4d8e-a0af-d4fc2b606295', 'b53efd6d-8b17-4cc0-8881-3f3c2848f837', 'b4c6d3cd-9208-4d80-a17f-e1ae4ac68284', '0c95818b-bfa9-4f72-98ab-8f7fbc70bd1e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:44 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:44 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:46 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.114s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Deleted volume successfully. Jul 03 13:00:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53af7522-e4b8-4177-be2e-40d7ed953b1e tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-58eb9e4f-4a39-464d-83b9-dd1319f0d211-delete_volume" released by "delete_volume" :: held 4.007s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Lock "cinder-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Acquiring lock "cinder-quobyte-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" acquired by "delete_volume" :: waited 0.052s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f858f-fdd5-4c1c-92c7-cc0bcb13de78]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:47 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 13:00:47 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:48 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 1.280s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:48 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af Jul 03 13:00:48 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:49 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" returned: 0 in 1.014s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Lock "cinder-quobyte-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af" released by "delete_volume" :: held 2.484s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Created reservations ['29c5f51c-db9e-47b4-a658-b8e62bb018ba', '293a64dc-6e6a-4756-b9e3-4b4829beb084', '25b95dfe-f95c-469e-a24c-714ffda4b8bb', '3985b7c4-a53d-4a3b-9325-e40f304a0862'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:50 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:50 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-3b3948b6-55ac-40bb-a572-e57ccfc0e3b8 req-3bbff36a-ba9b-4191-98d0-928474517fc3 tempest-TestInstancesWithCinderVolumes-992354953 None] Terminate volume connection completed successfully. Jul 03 13:00:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-3b3948b6-55ac-40bb-a572-e57ccfc0e3b8 req-3bbff36a-ba9b-4191-98d0-928474517fc3 tempest-TestInstancesWithCinderVolumes-992354953 None] Deleting attachment 6cde3748-0f96-4f93-9e94-37b2f6384db1. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:00:50 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Deleted volume successfully. Jul 03 13:00:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2672ed-4eaf-432d-b378-de61471ae4af tempest-TestStampPattern-165122556 None] Lock "cinder-73ae4d7a-28e9-4fa3-9a3a-f3525fbe45af-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Flow 'volume_create_manager' (070378eb-7782-49cf-b6ed-da557d2f0012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aedf05d-6529-41a8-b540-a7c71201caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aedf05d-6529-41a8-b540-a7c71201caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1010162116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a635afd3-4792-451d-82ad-2cb7274d9d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314b6c8d0f2d4a8d94e5b52ddad8486f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:52Z,use_quota=True,user_id='f31dd15a89914ade81d4d79fd2f8e87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dba76e0-4eab-45fe-8f28-1afb3ca8a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dba76e0-4eab-45fe-8f28-1afb3ca8a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86817cf5-ba00-416c-9ef8-495aac657476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86817cf5-ba00-416c-9ef8-495aac657476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a635afd3-4792-451d-82ad-2cb7274d9d13', 'volume_name': 'volume-a635afd3-4792-451d-82ad-2cb7274d9d13', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165a54e4-1f9a-4b16-81a6-e706a27401f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165a54e4-1f9a-4b16-81a6-e706a27401f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3888cd-ae0a-4089-925e-1df5748f734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Volume a635afd3-4792-451d-82ad-2cb7274d9d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a635afd3-4792-451d-82ad-2cb7274d9d13', 'volume_size': 2} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1010162116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a635afd3-4792-451d-82ad-2cb7274d9d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314b6c8d0f2d4a8d94e5b52ddad8486f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:52Z,use_quota=True,user_id='f31dd15a89914ade81d4d79fd2f8e87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Creating volume a635afd3-4792-451d-82ad-2cb7274d9d13 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:00:52 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:00:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 2147483648 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:52 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 2147483648 Jul 03 13:00:52 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:53 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 2147483648" returned: 0 in 1.080s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:53 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 Jul 03 13:00:53 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:54 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13" returned: 0 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3888cd-ae0a-4089-925e-1df5748f734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a635afd3-4792-451d-82ad-2cb7274d9d13', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45eea0b5-fbf5-4cea-8b6f-1feff8d5549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:00:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Volume volume-a635afd3-4792-451d-82ad-2cb7274d9d13 (a635afd3-4792-451d-82ad-2cb7274d9d13): created successfully Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45eea0b5-fbf5-4cea-8b6f-1feff8d5549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Flow 'volume_create_manager' (070378eb-7782-49cf-b6ed-da557d2f0012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:00:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ea8deedc-1983-49c6-9b23-01ba9f8e602d tempest-VolumesCloneNegativeTest-175091941 None] Created volume successfully. Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "cinder-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "cinder-quobyte-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-quobyte-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb10f544-ca83-41fc-9c3c-a70fbcb88820]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:54 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 13:00:54 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:55 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 0 in 1.060s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Acquiring lock "cinder-a635afd3-4792-451d-82ad-2cb7274d9d13-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Lock "cinder-a635afd3-4792-451d-82ad-2cb7274d9d13-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Acquiring lock "cinder-quobyte-a635afd3-4792-451d-82ad-2cb7274d9d13" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Lock "cinder-quobyte-a635afd3-4792-451d-82ad-2cb7274d9d13" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fdd85f-6899-4851-91f5-5c099ed6e0c7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:00:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:55 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 13:00:55 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:55 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 Jul 03 13:00:55 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:56 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 1 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:00:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:56 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d Jul 03 13:00:56 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:56 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13" returned: 0 in 1.007s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:56 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13 Jul 03 13:00:56 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:57 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-quobyte-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d" released by "delete_volume" :: held 2.948s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:57 devstack cinder-volume[86966]: WARNING cinder.quota [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-562641850-1984216262 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-562641850-1984216262, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:00:57 devstack cinder-volume[86966]: WARNING cinder.quota [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-562641850-1984216262 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-562641850-1984216262, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Created reservations ['bf74f184-615c-4555-9676-bd5e5385bd30', '81d9247a-56ed-4156-929a-d8b94d56d4d0', '16750d50-ee51-4c28-97b0-4ea165ade314', 'cf0e00fa-c1a1-4e70-805e-0fffac5cd32b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:57 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-a635afd3-4792-451d-82ad-2cb7274d9d13" returned: 0 in 0.717s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Lock "cinder-quobyte-a635afd3-4792-451d-82ad-2cb7274d9d13" released by "delete_volume" :: held 1.784s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:57 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:57 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Created reservations ['ff012179-0e30-4f4a-9d22-278971747d30', '2158b53d-7969-4fd8-aeaf-9ddea8924f07', 'ee06ff0c-1a1d-464e-88a6-6e02d286aa8c', '8fc39f0e-3b3b-4b87-9ac3-db057dd2a5ca'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:00:57 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:00:57 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:00:58 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:58 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Deleted volume successfully. Jul 03 13:00:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19f73e17-3d9b-4cb4-8eea-2288c6aaf033 tempest-VolumesCloneNegativeTest-175091941 None] Lock "cinder-a635afd3-4792-451d-82ad-2cb7274d9d13-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:00:59 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 03 13:00:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.404s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:00:59 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:00:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Deleted volume successfully. Jul 03 13:00:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-00bafdb9-fdb4-4066-a3fa-955298696079 tempest-TestInstancesWithCinderVolumes-992354953 None] Lock "cinder-34bd4a15-68cb-4ac6-ac85-d2ef456a0b6d-delete_volume" released by "delete_volume" :: held 4.669s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:02 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:01:02 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:03 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:01:08 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=88,cinder:SELECT=58,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=51,cinder:UPDATE=68,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Flow 'volume_create_manager' (d55675b3-715d-4ff8-9e26-cdea6d2c3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75666c12-5a83-4925-a859-10d09d187b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75666c12-5a83-4925-a859-10d09d187b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-17131365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5c0526-a75e-42f8-9113-3667f8c80eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92b87bfab784341916ed97ec7f7896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:09Z,use_quota=True,user_id='43056000a70e41d8b07e6b2234025603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc263b88-648b-4526-b38b-0722e4b524a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc263b88-648b-4526-b38b-0722e4b524a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af840f12-3c5d-4616-898a-47d20e335a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af840f12-3c5d-4616-898a-47d20e335a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5c0526-a75e-42f8-9113-3667f8c80eb2', 'volume_name': 'volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b29fd9-2ca4-40b0-a9d7-312777fef67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b29fd9-2ca4-40b0-a9d7-312777fef67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc5660e-758f-410b-807a-8f6a9f6c4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Volume 8f5c0526-a75e-42f8-9113-3667f8c80eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2', 'volume_size': 1} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-17131365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5c0526-a75e-42f8-9113-3667f8c80eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92b87bfab784341916ed97ec7f7896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:09Z,use_quota=True,user_id='43056000a70e41d8b07e6b2234025603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Creating volume 8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:01:09 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:01:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:09 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 1073741824 Jul 03 13:01:09 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:10 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 1073741824" returned: 0 in 1.423s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:10 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:10 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:11 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 1.074s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:01:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc5660e-758f-410b-807a-8f6a9f6c4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38800526-9d70-44a2-a38b-3e1a531ef44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Volume volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 (8f5c0526-a75e-42f8-9113-3667f8c80eb2): created successfully Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38800526-9d70-44a2-a38b-3e1a531ef44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Flow 'volume_create_manager' (d55675b3-715d-4ff8-9e26-cdea6d2c3064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fbae72d3-ee40-465a-b078-1a0ed21bc2ec tempest-VolumeDependencyTests-859033151 None] Created volume successfully. Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Creating offline snapshot f66a3bb4-c4d2-4188-a1ac-10320ba21051 of volume 8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e0c9c-3892-4380-8060-add5b1930dce]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:13 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:13 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:14 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 1.219s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:14 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 1G Jul 03 13:01:14 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:15 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 1G" returned: 0 in 1.069s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:15 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 Jul 03 13:01:15 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:16 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051" returned: 0 in 0.903s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:16 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 is being set with open permissions: ugo+rw Jul 03 13:01:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:16 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 Jul 03 13:01:16 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:17 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:17 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info Jul 03 13:01:17 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:18 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info" returned: 0 in 1.070s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:18 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info is being set with open permissions: ugo+rw Jul 03 13:01:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:18 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info Jul 03 13:01:18 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:19 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.info" returned: 0 in 0.994s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.264s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-28dc8859-39cc-4c5b-98ed-7cb67c449b4b tempest-VolumeDependencyTests-859033151 None] Create snapshot completed successfully Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Flow 'volume_create_manager' (bef97982-b450-4db7-ba64-93829dda1c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2190600f-419b-4aa1-9cfd-5c6b557be7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2190600f-419b-4aa1-9cfd-5c6b557be7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1472225020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4fff32-631b-4062-949d-116b8f4c0936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92b87bfab784341916ed97ec7f7896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f66a3bb4-c4d2-4188-a1ac-10320ba21051,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:21Z,use_quota=True,user_id='43056000a70e41d8b07e6b2234025603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd10600b-43e0-4bc7-bed9-cfdeb6f8876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd10600b-43e0-4bc7-bed9-cfdeb6f8876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3914bbe6-ca28-4a16-af33-20b1889cee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3914bbe6-ca28-4a16-af33-20b1889cee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f4fff32-631b-4062-949d-116b8f4c0936', 'volume_name': 'volume-3f4fff32-631b-4062-949d-116b8f4c0936', 'volume_size': 1, 'snapshot_id': 'f66a3bb4-c4d2-4188-a1ac-10320ba21051'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619df3a2-0309-4bae-a42b-cde736be15d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619df3a2-0309-4bae-a42b-cde736be15d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7ebad5-0f6f-4a2a-9720-aeb55ef7f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Volume 3f4fff32-631b-4062-949d-116b8f4c0936: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f4fff32-631b-4062-949d-116b8f4c0936', 'volume_size': 1, 'snapshot_id': 'f66a3bb4-c4d2-4188-a1ac-10320ba21051'} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-quobyte-f66a3bb4-c4d2-4188-a1ac-10320ba21051-3f4fff32-631b-4062-949d-116b8f4c0936" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-f66a3bb4-c4d2-4188-a1ac-10320ba21051-3f4fff32-631b-4062-949d-116b8f4c0936" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Creating volume 3f4fff32-631b-4062-949d-116b8f4c0936 from snapshot f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-quobyte-3f4fff32-631b-4062-949d-116b8f4c0936" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-3f4fff32-631b-4062-949d-116b8f4c0936" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] snapshot: f66a3bb4-c4d2-4188-a1ac-10320ba21051, volume: 3f4fff32-631b-4062-949d-116b8f4c0936, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546bccc-c67e-4fd5-abd8-ec33e874842b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:21 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 Jul 03 13:01:21 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:22 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051" returned: 0 in 1.042s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:01:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:01:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:01:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b42acdf-72ef-42ee-b100-1bc49722c27b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:22 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:22 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:23 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 1.028s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:23 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:01:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:23 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 Jul 03 13:01:23 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:30 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936" returned: 0 in 7.008s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ffabde-2ce3-46c2-9811-c2c8aa1dae8d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:30 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:30 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:31 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:01:31 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:01:32 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 1.373s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:01:32 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Converted 1024.00 MB image at 146.10 MB/s Jul 03 13:01:32 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 is being set with open permissions: ugo+rw Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:32 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 Jul 03 13:01:32 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:32 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-3f4fff32-631b-4062-949d-116b8f4c0936" released by "_copy_volume_from_snapshot" :: held 11.343s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-f66a3bb4-c4d2-4188-a1ac-10320ba21051-3f4fff32-631b-4062-949d-116b8f4c0936" released by "_create_volume_from_snapshot" :: held 11.383s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.406s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7ebad5-0f6f-4a2a-9720-aeb55ef7f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4fff32-631b-4062-949d-116b8f4c0936', 'volume_size': 1, 'snapshot_id': 'f66a3bb4-c4d2-4188-a1ac-10320ba21051'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b567eea5-61f3-4a57-ad21-1779e694d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Volume volume-3f4fff32-631b-4062-949d-116b8f4c0936 (3f4fff32-631b-4062-949d-116b8f4c0936): created successfully Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b567eea5-61f3-4a57-ad21-1779e694d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Flow 'volume_create_manager' (bef97982-b450-4db7-ba64-93829dda1c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-83dd1671-774a-4d25-b9d7-03cbee8f1c9d tempest-VolumeDependencyTests-859033151 None] Created volume successfully. Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-f66a3bb4-c4d2-4188-a1ac-10320ba21051-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-f66a3bb4-c4d2-4188-a1ac-10320ba21051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-quobyte-8f5c0526-a75e-42f8-9113-3667f8c80eb2" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-8f5c0526-a75e-42f8-9113-3667f8c80eb2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-quobyte-f66a3bb4-c4d2-4188-a1ac-10320ba21051" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-f66a3bb4-c4d2-4188-a1ac-10320ba21051" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Deleting offline snapshot f66a3bb4-c4d2-4188-a1ac-10320ba21051 of volume 8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] snapshot_file for this snap is: volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb96d3-175d-4bd5-b811-944107cc8fd6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:33 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 Jul 03 13:01:33 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:34 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051" returned: 0 in 1.035s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:01:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254afeb-7462-485e-9f61-5e651d8c3e68]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:35 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:35 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:36 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 1.206s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:36 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 Jul 03 13:01:36 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:37 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051" returned: 0 in 1.229s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:37 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051 Jul 03 13:01:37 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:38 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2.f66a3bb4-c4d2-4188-a1ac-10320ba21051" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-f66a3bb4-c4d2-4188-a1ac-10320ba21051" released by "_delete_snapshot" :: held 4.596s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-8f5c0526-a75e-42f8-9113-3667f8c80eb2" released by "delete_snapshot" :: held 4.631s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Created reservations ['510d2f49-6816-47d7-8192-cbcd234c5a6d', 'db5bc64a-b2ca-4320-a56e-b72a16b6cf62', 'fcd9e55d-8cac-49ca-aa89-4b7d472d97f8', '90de4b26-da8e-48ae-97a6-0f33173cd0fd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:01:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Delete snapshot completed successfully. Jul 03 13:01:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7681c373-b9a8-45cd-91c5-997d74159ca3 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-f66a3bb4-c4d2-4188-a1ac-10320ba21051-delete_snapshot" released by "delete_snapshot" :: held 4.958s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-8f5c0526-a75e-42f8-9113-3667f8c80eb2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-8f5c0526-a75e-42f8-9113-3667f8c80eb2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-quobyte-8f5c0526-a75e-42f8-9113-3667f8c80eb2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-8f5c0526-a75e-42f8-9113-3667f8c80eb2" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c255c-bc5a-457a-8d40-a482d810a329]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:39 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:39 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:40 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:40 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2 Jul 03 13:01:40 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:41 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8f5c0526-a75e-42f8-9113-3667f8c80eb2" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-8f5c0526-a75e-42f8-9113-3667f8c80eb2" released by "delete_volume" :: held 1.905s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Created reservations ['80dd02ca-7da0-4e20-8009-2951362833ff', '45d1b1d6-9c1d-46c2-9be3-cda23ca4fd35', '0a8c705b-9de9-4046-a2e0-92d7beb6325f', 'bb435460-8ddc-4aff-a99a-e1d239f10427'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:41 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:01:41 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-3f4fff32-631b-4062-949d-116b8f4c0936-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-3f4fff32-631b-4062-949d-116b8f4c0936-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "cinder-quobyte-3f4fff32-631b-4062-949d-116b8f4c0936" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-3f4fff32-631b-4062-949d-116b8f4c0936" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b1db2f-7975-4600-a2c2-8ea9bf008bc7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:41 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 Jul 03 13:01:41 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:42 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.017s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:01:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Deleted volume successfully. Jul 03 13:01:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b90865e7-539b-4809-be9c-96f35b6c49c5 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-8f5c0526-a75e-42f8-9113-3667f8c80eb2-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:42 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936" returned: 0 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:42 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936 Jul 03 13:01:42 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:43 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3f4fff32-631b-4062-949d-116b8f4c0936" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-quobyte-3f4fff32-631b-4062-949d-116b8f4c0936" released by "delete_volume" :: held 1.878s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Created reservations ['c84ee06f-b5d4-40b1-8d50-cc7dd49e52ce', '74df4b7e-b042-48d0-a8e2-a306edd18469', '04dd0842-1103-47b9-b6d4-d124fc4a2246', 'fb3267af-0198-4958-b7e8-85bd50bbb78c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:01:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:44 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:01:44 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:45 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.067s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:01:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Deleted volume successfully. Jul 03 13:01:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa2e0d29-7191-4555-848b-64940faac7b6 tempest-VolumeDependencyTests-859033151 None] Lock "cinder-3f4fff32-631b-4062-949d-116b8f4c0936-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Flow 'volume_create_manager' (157916b8-edea-46ba-99c2-d50d018fae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8144e-7809-45fc-a664-52bb978fbb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8144e-7809-45fc-a664-52bb978fbb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-308916962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c333ab-ae0b-4122-be0a-0a2eccd59557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b56df92a2874a019ff6ebbd11a748c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:51Z,use_quota=True,user_id='6e555565ed21497eabe9d6af5ba41422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af19726c-2442-4e9c-9010-c5c51a7c5018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af19726c-2442-4e9c-9010-c5c51a7c5018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4ebff6-cbbf-408e-93a5-d0caf77bf43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4ebff6-cbbf-408e-93a5-d0caf77bf43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c333ab-ae0b-4122-be0a-0a2eccd59557', 'volume_name': 'volume-64c333ab-ae0b-4122-be0a-0a2eccd59557', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd5d84d-9911-4148-99cb-449a7d43a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd5d84d-9911-4148-99cb-449a7d43a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7db18cb-de39-4eab-b813-a9cd21bf9a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Volume 64c333ab-ae0b-4122-be0a-0a2eccd59557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c333ab-ae0b-4122-be0a-0a2eccd59557', 'volume_size': 1} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-308916962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c333ab-ae0b-4122-be0a-0a2eccd59557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b56df92a2874a019ff6ebbd11a748c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:51Z,use_quota=True,user_id='6e555565ed21497eabe9d6af5ba41422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Creating volume 64c333ab-ae0b-4122-be0a-0a2eccd59557 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:01:51 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:01:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:51 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 1073741824 Jul 03 13:01:51 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:52 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 1073741824" returned: 0 in 1.318s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:52 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 Jul 03 13:01:52 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:53 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557" returned: 0 in 1.010s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7db18cb-de39-4eab-b813-a9cd21bf9a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c333ab-ae0b-4122-be0a-0a2eccd59557', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7eb159-266e-4d2d-b2f0-76d53fab64c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Volume volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 (64c333ab-ae0b-4122-be0a-0a2eccd59557): created successfully Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7eb159-266e-4d2d-b2f0-76d53fab64c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Flow 'volume_create_manager' (157916b8-edea-46ba-99c2-d50d018fae8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8ff25033-68d1-4829-8556-37e19910428b tempest-ProjectReaderTests-1734639210 None] Created volume successfully. Jul 03 13:01:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "cinder-64c333ab-ae0b-4122-be0a-0a2eccd59557-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-64c333ab-ae0b-4122-be0a-0a2eccd59557-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "cinder-quobyte-64c333ab-ae0b-4122-be0a-0a2eccd59557" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:01:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-quobyte-64c333ab-ae0b-4122-be0a-0a2eccd59557" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:01:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86febcc-8b10-48ed-ab07-08a2835ca4a3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:01:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:55 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 Jul 03 13:01:55 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:55 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557" returned: 0 in 0.953s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:55 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557 Jul 03 13:01:55 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:56 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-64c333ab-ae0b-4122-be0a-0a2eccd59557" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-quobyte-64c333ab-ae0b-4122-be0a-0a2eccd59557" released by "delete_volume" :: held 1.704s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Created reservations ['6dcfb45e-6659-480f-a9bb-cd0811b77b36', '784b33db-8b8e-4489-9e84-b6f6e1a33f10', '38b6df0f-cc4d-43db-a7a5-ac766ba46dba', 'd5c7e748-da2d-4608-b450-1773378b03a5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:56 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:01:56 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:57 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.967s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:01:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Deleted volume successfully. Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Flow 'volume_create_manager' (d535921e-6338-4373-88c8-683bd41dbfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb3f575-6d8d-488b-9eba-c7676e281d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759277e3-2663-4bbb-8d32-4f5dfc2726d9 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-64c333ab-ae0b-4122-be0a-0a2eccd59557-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb3f575-6d8d-488b-9eba-c7676e281d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450699759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e989bb36-4e09-4bf9-a396-0a5202b9b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b56df92a2874a019ff6ebbd11a748c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:58Z,use_quota=True,user_id='6e555565ed21497eabe9d6af5ba41422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e797007f-1cc6-4a60-a3b8-6425b406d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e797007f-1cc6-4a60-a3b8-6425b406d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db573f4f-d825-42d2-971a-af89692c11f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db573f4f-d825-42d2-971a-af89692c11f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e989bb36-4e09-4bf9-a396-0a5202b9b75b', 'volume_name': 'volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1f311a-d775-4b72-a14a-ef12650c0e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1f311a-d775-4b72-a14a-ef12650c0e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9998ed6-08f9-4571-8f39-407355356af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Volume e989bb36-4e09-4bf9-a396-0a5202b9b75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b', 'volume_size': 1} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450699759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e989bb36-4e09-4bf9-a396-0a5202b9b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b56df92a2874a019ff6ebbd11a748c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:58Z,use_quota=True,user_id='6e555565ed21497eabe9d6af5ba41422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Creating volume e989bb36-4e09-4bf9-a396-0a5202b9b75b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:01:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:01:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:57 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b 1073741824 Jul 03 13:01:57 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:58 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b 1073741824" returned: 0 in 0.989s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:01:58 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b Jul 03 13:01:58 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:01:59 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9998ed6-08f9-4571-8f39-407355356af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be932396-bdb7-4bfa-a429-dc8395917b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:01:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Volume volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b (e989bb36-4e09-4bf9-a396-0a5202b9b75b): created successfully Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be932396-bdb7-4bfa-a429-dc8395917b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:01:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Flow 'volume_create_manager' (d535921e-6338-4373-88c8-683bd41dbfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:01:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6ae39b97-d177-4f38-82c7-f4a6ce48c835 tempest-ProjectReaderTests-1734639210 None] Created volume successfully. Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "cinder-e989bb36-4e09-4bf9-a396-0a5202b9b75b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-e989bb36-4e09-4bf9-a396-0a5202b9b75b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "cinder-quobyte-e989bb36-4e09-4bf9-a396-0a5202b9b75b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-quobyte-e989bb36-4e09-4bf9-a396-0a5202b9b75b" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7645e2-99ca-47ab-85eb-5c99a2c8e3d4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:01 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b Jul 03 13:02:01 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:02 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:02:02 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:03 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b" returned: 0 in 1.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:03 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b Jul 03 13:02:03 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:03 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:02:04 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e989bb36-4e09-4bf9-a396-0a5202b9b75b" returned: 0 in 1.473s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-quobyte-e989bb36-4e09-4bf9-a396-0a5202b9b75b" released by "delete_volume" :: held 3.253s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Created reservations ['1b8a0a5d-b805-427b-8cd6-a3259144d6d6', '9d7d8369-d66b-4bee-a5c9-9b2595765338', '7567d920-a577-4a63-811a-63aea5d90baf', '5591c0e3-0532-4bb4-8735-76f0a4bea8f8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:05 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:02:05 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:06 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.098s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:02:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Deleted volume successfully. Jul 03 13:02:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dd857d0d-cf14-4854-a6e0-ba73e2731f39 tempest-ProjectReaderTests-1734639210 None] Lock "cinder-e989bb36-4e09-4bf9-a396-0a5202b9b75b-delete_volume" released by "delete_volume" :: held 4.938s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:02:14 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=37,cinder:SELECT=32,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:02:16 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=28,cinder:UPDATE=53,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Flow 'volume_create_manager' (514fcee5-59e5-4ccb-8ddb-ca3adee53990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746fb55-abea-4e5c-a288-c83213921933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746fb55-abea-4e5c-a288-c83213921933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1973395954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38efef5-1e64-456f-8565-fd911d25e1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f504c0f26845b0991ffda45569297f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:18Z,use_quota=True,user_id='1711de2842d947569db6221bcc0ba453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65346fea-505c-41d8-bd30-21d23a091771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65346fea-505c-41d8-bd30-21d23a091771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16d9bed-99e9-4472-8cd8-48eb5e35eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16d9bed-99e9-4472-8cd8-48eb5e35eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38efef5-1e64-456f-8565-fd911d25e1fa', 'volume_name': 'volume-b38efef5-1e64-456f-8565-fd911d25e1fa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ce8042-6b40-4466-941c-da8883611cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ce8042-6b40-4466-941c-da8883611cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0eda8f8-6abc-4992-9298-ff32d87cf4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Volume b38efef5-1e64-456f-8565-fd911d25e1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38efef5-1e64-456f-8565-fd911d25e1fa', 'volume_size': 1} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1973395954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38efef5-1e64-456f-8565-fd911d25e1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f504c0f26845b0991ffda45569297f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:18Z,use_quota=True,user_id='1711de2842d947569db6221bcc0ba453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Creating volume b38efef5-1e64-456f-8565-fd911d25e1fa {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:02:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:18 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa 1073741824 Jul 03 13:02:18 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:19 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa 1073741824" returned: 0 in 0.982s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:19 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa Jul 03 13:02:19 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:20 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0eda8f8-6abc-4992-9298-ff32d87cf4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38efef5-1e64-456f-8565-fd911d25e1fa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f1a6c8-9104-499d-a816-a1a6cff4e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Volume volume-b38efef5-1e64-456f-8565-fd911d25e1fa (b38efef5-1e64-456f-8565-fd911d25e1fa): created successfully Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f1a6c8-9104-499d-a816-a1a6cff4e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Flow 'volume_create_manager' (514fcee5-59e5-4ccb-8ddb-ca3adee53990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-60aa52f6-dc3e-4de6-8854-4ce55fe3b0b7 tempest-TestMinimumBasicScenario-680502350 None] Created volume successfully. Jul 03 13:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a0e8b-5c4b-42bf-97ed-5848fbf070d1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:25 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa Jul 03 13:02:25 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:26 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa" returned: 0 in 1.461s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.544s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-b38efef5-1e64-456f-8565-fd911d25e1fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abacc658-06aa-4dae-9b71-621f3b8c4dc7', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:02:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-5702c410-8dd6-4364-80ea-05b39a28e431 req-206ba0aa-d98a-4cef-9ca4-21e371eb2936 tempest-TestMinimumBasicScenario-680502350 None] attachment_update completed successfully. Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Flow 'volume_create_manager' (a1589cc5-f799-443b-86e8-3aa4520315f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251bd624-900b-41b8-b8ad-3d54f2e9ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251bd624-900b-41b8-b8ad-3d54f2e9ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1688520687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613fa5f4-4ca7-4183-b73b-ebfcbc322bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62172b9c59654453936a1441c27aea50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:28Z,use_quota=True,user_id='5b8cdee85ff84272903964c60c05b80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2a1248-25ca-47b8-97c3-c183dae53bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2a1248-25ca-47b8-97c3-c183dae53bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f6cf3c-a63e-456b-b075-5c4a4eb07b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f6cf3c-a63e-456b-b075-5c4a4eb07b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613fa5f4-4ca7-4183-b73b-ebfcbc322bc6', 'volume_name': 'volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bfee4b-8fdf-4aa7-bb60-e21454f491e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bfee4b-8fdf-4aa7-bb60-e21454f491e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f8a8f7-56c7-44b5-b8d7-fd834d5ff624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Volume 613fa5f4-4ca7-4183-b73b-ebfcbc322bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6', 'volume_size': 1} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1688520687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613fa5f4-4ca7-4183-b73b-ebfcbc322bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62172b9c59654453936a1441c27aea50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:28Z,use_quota=True,user_id='5b8cdee85ff84272903964c60c05b80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Creating volume 613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:02:28 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:28 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 1073741824 Jul 03 13:02:28 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:29 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 1073741824" returned: 0 in 1.144s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:29 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 Jul 03 13:02:29 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:30 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f8a8f7-56c7-44b5-b8d7-fd834d5ff624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c81396-f1b7-4511-a0a3-8c50adae70e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Volume volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 (613fa5f4-4ca7-4183-b73b-ebfcbc322bc6): created successfully Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c81396-f1b7-4511-a0a3-8c50adae70e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Flow 'volume_create_manager' (a1589cc5-f799-443b-86e8-3aa4520315f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-78906272-935b-4173-a90c-51725511d0ee tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Created volume successfully. Jul 03 13:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d72363-6487-4c86-b0bc-1ed8d29782a6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:35 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 Jul 03 13:02:35 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:36 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" returned: 0 in 1.114s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.145s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514', 'name': 'volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5c336cb-ab97-4deb-929b-22b76f46f1c0', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:02:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-67c28c0d-e205-4d5f-b861-4a5992236aed req-536f1cf9-9899-46cf-adff-e1c3cadff0f2 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] attachment_update completed successfully. Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Flow 'volume_create_manager' (823f92f6-b590-4438-bf07-33b3cfc9f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1bb0fb-f796-42d4-b183-f37b049bf1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1bb0fb-f796-42d4-b183-f37b049bf1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-390453032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32de34dc-160b-4137-92df-88e3ebadad0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5f05dc015749f79831e115346ff8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:42Z,use_quota=True,user_id='aff3dd7a927c4980b5e0a3ebbb427144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55f23b6-8208-4a1a-9369-e578f9900add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55f23b6-8208-4a1a-9369-e578f9900add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a0b212-177c-4249-9fa2-1ef5d5f5f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a0b212-177c-4249-9fa2-1ef5d5f5f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32de34dc-160b-4137-92df-88e3ebadad0f', 'volume_name': 'volume-32de34dc-160b-4137-92df-88e3ebadad0f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946a1652-0a97-4599-b0dc-feea2fd5d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946a1652-0a97-4599-b0dc-feea2fd5d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe2302e-b8fd-42b6-baf1-6a3614d57067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Volume 32de34dc-160b-4137-92df-88e3ebadad0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32de34dc-160b-4137-92df-88e3ebadad0f', 'volume_size': 1} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-390453032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32de34dc-160b-4137-92df-88e3ebadad0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5f05dc015749f79831e115346ff8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:42Z,use_quota=True,user_id='aff3dd7a927c4980b5e0a3ebbb427144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Creating volume 32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:02:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:41 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f 1073741824 Jul 03 13:02:41 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:42 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f 1073741824" returned: 0 in 1.194s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:42 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:02:42 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b3266f42-b08e-45f1-9881-9694e51aa5f4 req-7172d0bb-1e70-47cb-a6d4-516f8cf33688 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Terminate volume connection completed successfully. Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b3266f42-b08e-45f1-9881-9694e51aa5f4 req-7172d0bb-1e70-47cb-a6d4-516f8cf33688 tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Deleting attachment c5c336cb-ab97-4deb-929b-22b76f46f1c0. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:02:43 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe2302e-b8fd-42b6-baf1-6a3614d57067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32de34dc-160b-4137-92df-88e3ebadad0f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853f10b3-eb01-457a-b436-26f9eae3e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Volume volume-32de34dc-160b-4137-92df-88e3ebadad0f (32de34dc-160b-4137-92df-88e3ebadad0f): created successfully Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853f10b3-eb01-457a-b436-26f9eae3e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Flow 'volume_create_manager' (823f92f6-b590-4438-bf07-33b3cfc9f977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-33321ed6-289e-46e5-a981-cafa98933cd1 tempest-SnapshotDependencyTests-2080903796 None] Created volume successfully. Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Creating offline snapshot 857cf816-2917-4721-9e58-f4a4fbab8db8 of volume 32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa9fab3-9425-43cb-98eb-29c5852159f3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:45 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:02:45 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Acquiring lock "cinder-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "cinder-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Acquiring lock "cinder-quobyte-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:02:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "cinder-quobyte-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:02:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7449aa1-d8e9-489b-8c3b-c2d62f94a10c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:46 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 1.047s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:46 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 1G Jul 03 13:02:46 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:46 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 Jul 03 13:02:46 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:47 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" returned: 0 in 0.956s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:47 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6 Jul 03 13:02:47 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:47 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 1G" returned: 0 in 1.017s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32de34dc-160b-4137-92df-88e3ebadad0f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:47 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32de34dc-160b-4137-92df-88e3ebadad0f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 Jul 03 13:02:47 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:47 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" returned: 0 in 0.817s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "cinder-quobyte-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6" released by "delete_volume" :: held 1.876s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Created reservations ['4c83347c-ad17-4fe5-b080-5661f19723b4', '38eb3085-eeac-45a6-bf66-a2bc2d83e215', '8c730d8c-26aa-4fa5-b4bd-bc7bbdf62e51', '6beeca5b-0fc5-4473-ba7e-d90f909d180b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:02:47 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32de34dc-160b-4137-92df-88e3ebadad0f -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 is being set with open permissions: ugo+rw Jul 03 13:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:47 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 Jul 03 13:02:47 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:48 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:02:48 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:48 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:48 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info Jul 03 13:02:48 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:48 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:02:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Deleted volume successfully. Jul 03 13:02:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-312ab4b1-a41e-4703-af01-fb8f5753fb7c tempest-TestServerVolumeAttachScenarioOldVersion-983904877 None] Lock "cinder-613fa5f4-4ca7-4183-b73b-ebfcbc322bc6-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:02:49 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info" returned: 0 in 0.959s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:49 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info is being set with open permissions: ugo+rw Jul 03 13:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:49 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info Jul 03 13:02:49 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:50 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.info" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.493s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-84584c35-86dc-4c8f-84c7-95f8c23c9c4a tempest-SnapshotDependencyTests-2080903796 None] Create snapshot completed successfully Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Flow 'volume_create_manager' (bb5f7893-b692-4bc0-b97b-405b660e1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97561d6f-7caa-4985-a3e6-efd8fed4c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97561d6f-7caa-4985-a3e6-efd8fed4c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ad6d88-403e-4a41-9493-2d450d0ba2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5f05dc015749f79831e115346ff8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=857cf816-2917-4721-9e58-f4a4fbab8db8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:52Z,use_quota=True,user_id='aff3dd7a927c4980b5e0a3ebbb427144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354d1540-234f-4270-98d2-b947d589ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354d1540-234f-4270-98d2-b947d589ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cca6b90-e32e-49b9-84b8-7eb3956e205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cca6b90-e32e-49b9-84b8-7eb3956e205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19ad6d88-403e-4a41-9493-2d450d0ba2ea', 'volume_name': 'volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea', 'volume_size': 1, 'snapshot_id': '857cf816-2917-4721-9e58-f4a4fbab8db8'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7a128d-d67f-4f47-bbb2-a35e0e1c2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7a128d-d67f-4f47-bbb2-a35e0e1c2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a88a1dd-48dc-48e0-ab4c-81d7da4f307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:02:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Volume 19ad6d88-403e-4a41-9493-2d450d0ba2ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea', 'volume_size': 1, 'snapshot_id': '857cf816-2917-4721-9e58-f4a4fbab8db8'} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-quobyte-857cf816-2917-4721-9e58-f4a4fbab8db8-19ad6d88-403e-4a41-9493-2d450d0ba2ea" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-857cf816-2917-4721-9e58-f4a4fbab8db8-19ad6d88-403e-4a41-9493-2d450d0ba2ea" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Creating volume 19ad6d88-403e-4a41-9493-2d450d0ba2ea from snapshot 857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-quobyte-19ad6d88-403e-4a41-9493-2d450d0ba2ea" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-19ad6d88-403e-4a41-9493-2d450d0ba2ea" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] snapshot: 857cf816-2917-4721-9e58-f4a4fbab8db8, volume: 19ad6d88-403e-4a41-9493-2d450d0ba2ea, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c74be96-0c99-4ab2-82ab-aecf3b3806bd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:52 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 Jul 03 13:02:52 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:53 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8" returned: 0 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32de34dc-160b-4137-92df-88e3ebadad0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:02:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7af2ab8-02fd-49e7-bb88-e352851c7e94]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:53 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:02:53 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:02:54 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 03 13:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 1.167s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:02:54 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:02:54 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea Jul 03 13:02:54 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:02 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:02 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea" returned: 0 in 7.533s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7ea21-02a0-40c5-a1af-018d6b5f314e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:02 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:03:02 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=19,cinder:SELECT=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:03:02 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:03 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 1.376s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:03 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:03:03 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Converted 1024.00 MB image at 135.86 MB/s Jul 03 13:03:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea is being set with open permissions: ugo+rw Jul 03 13:03:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:03 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea Jul 03 13:03:03 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:04 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-19ad6d88-403e-4a41-9493-2d450d0ba2ea" released by "_copy_volume_from_snapshot" :: held 11.880s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-857cf816-2917-4721-9e58-f4a4fbab8db8-19ad6d88-403e-4a41-9493-2d450d0ba2ea" released by "_create_volume_from_snapshot" :: held 11.919s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.936s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a88a1dd-48dc-48e0-ab4c-81d7da4f307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea', 'volume_size': 1, 'snapshot_id': '857cf816-2917-4721-9e58-f4a4fbab8db8'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f80f7e-abf5-4d29-a65a-e9739d91a6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Volume volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea (19ad6d88-403e-4a41-9493-2d450d0ba2ea): created successfully Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f80f7e-abf5-4d29-a65a-e9739d91a6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Flow 'volume_create_manager' (bb5f7893-b692-4bc0-b97b-405b660e1edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-34c58f14-8e5d-46a6-91b8-ffda50ea30fe tempest-SnapshotDependencyTests-2080903796 None] Created volume successfully. Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-857cf816-2917-4721-9e58-f4a4fbab8db8-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-857cf816-2917-4721-9e58-f4a4fbab8db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-quobyte-32de34dc-160b-4137-92df-88e3ebadad0f" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-32de34dc-160b-4137-92df-88e3ebadad0f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-quobyte-857cf816-2917-4721-9e58-f4a4fbab8db8" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-857cf816-2917-4721-9e58-f4a4fbab8db8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Deleting offline snapshot 857cf816-2917-4721-9e58-f4a4fbab8db8 of volume 32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] snapshot_file for this snap is: volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f94c19-7c46-4d08-99e5-28956e02fcff]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:05 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 Jul 03 13:03:05 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:06 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32de34dc-160b-4137-92df-88e3ebadad0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:03:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc5a340-4dd7-40cc-a1a1-93865ec60b94]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:06 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:03:06 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:07 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 0.995s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:07 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 Jul 03 13:03:07 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:08 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8" returned: 0 in 1.007s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:08 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8 Jul 03 13:03:08 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:09 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f.857cf816-2917-4721-9e58-f4a4fbab8db8" returned: 0 in 0.951s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-857cf816-2917-4721-9e58-f4a4fbab8db8" released by "_delete_snapshot" :: held 4.111s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-32de34dc-160b-4137-92df-88e3ebadad0f" released by "delete_snapshot" :: held 4.137s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Created reservations ['cac49f9a-7152-4117-8c63-143b5da66932', '0a3bb3cf-8e92-4b94-a6eb-c39efef1b177', '184ef3fa-9bc1-4590-9fc2-fde1cfed1b35', 'c6421bad-d825-4e36-8c4e-108fd971e870'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Delete snapshot completed successfully. Jul 03 13:03:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9e72aaf-768b-4211-a2f2-779a75fb45fb tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-857cf816-2917-4721-9e58-f4a4fbab8db8-delete_snapshot" released by "delete_snapshot" :: held 4.433s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-32de34dc-160b-4137-92df-88e3ebadad0f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-32de34dc-160b-4137-92df-88e3ebadad0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-quobyte-32de34dc-160b-4137-92df-88e3ebadad0f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-32de34dc-160b-4137-92df-88e3ebadad0f" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[30915545-524e-4446-8bfd-5941ac7b3d88]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:10 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:03:10 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:11 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 1.140s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:11 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f Jul 03 13:03:11 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:12 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-32de34dc-160b-4137-92df-88e3ebadad0f" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-32de34dc-160b-4137-92df-88e3ebadad0f" released by "delete_volume" :: held 2.040s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Created reservations ['bcd1ff51-486d-42b2-919e-aece1b78a6b9', '4ab21174-1a44-4891-a825-41bd0f748206', 'b4ebe798-729c-4c1d-8448-0aeaf675ce98', '12e44f3e-9fb3-40c6-95b5-f36f24dc5547'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:12 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:12 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:13 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Deleted volume successfully. Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ca49f325-15e4-47d9-bf6c-574d32496efc tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-32de34dc-160b-4137-92df-88e3ebadad0f-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-19ad6d88-403e-4a41-9493-2d450d0ba2ea-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-19ad6d88-403e-4a41-9493-2d450d0ba2ea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "cinder-quobyte-19ad6d88-403e-4a41-9493-2d450d0ba2ea" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-19ad6d88-403e-4a41-9493-2d450d0ba2ea" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9302f14d-7b90-47b2-9181-2fad2ef73d53]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:14 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea Jul 03 13:03:14 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:14 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea" returned: 0 in 0.887s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:14 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea Jul 03 13:03:14 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:15 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-19ad6d88-403e-4a41-9493-2d450d0ba2ea" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-quobyte-19ad6d88-403e-4a41-9493-2d450d0ba2ea" released by "delete_volume" :: held 1.686s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Created reservations ['9afbdbd6-5c94-4f35-9816-1eba76ced25d', '3e5c525e-005c-4343-a267-63054fa8967a', '99f68c2e-f25b-4eb3-89ab-00d78f2881be', '2ed581cf-8277-472d-8db3-4ab18e2e00e5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:15 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:15 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (cf591992-548b-492d-b961-5359261261d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8404860a-65ca-4383-a5cc-b5030dbbcbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8404860a-65ca-4383-a5cc-b5030dbbcbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544787191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8d348-4f47-4473-a117-0c207f685a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:16Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a713d5dd-9c0e-424d-b466-ad115a3fb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a713d5dd-9c0e-424d-b466-ad115a3fb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36060e73-b532-4ab0-b4e0-4fa81d3a8238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36060e73-b532-4ab0-b4e0-4fa81d3a8238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e8d348-4f47-4473-a117-0c207f685a95', 'volume_name': 'volume-10e8d348-4f47-4473-a117-0c207f685a95', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f6db97-a588-43f7-92c6-4290f7240b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f6db97-a588-43f7-92c6-4290f7240b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078f7083-9c46-4538-8c8b-72f3c80cf2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume 10e8d348-4f47-4473-a117-0c207f685a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e8d348-4f47-4473-a117-0c207f685a95', 'volume_size': 1} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544787191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8d348-4f47-4473-a117-0c207f685a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:16Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating volume 10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:16 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 1073741824 Jul 03 13:03:16 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:16 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.814s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Deleted volume successfully. Jul 03 13:03:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a37018c7-cd46-44d5-8f44-9f2909d77bf6 tempest-SnapshotDependencyTests-2080903796 None] Lock "cinder-19ad6d88-403e-4a41-9493-2d450d0ba2ea-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:17 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 1073741824" returned: 0 in 1.077s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:17 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 Jul 03 13:03:17 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:18 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078f7083-9c46-4538-8c8b-72f3c80cf2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e8d348-4f47-4473-a117-0c207f685a95', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9ed155-20fc-432d-9624-87b0f319cb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume volume-10e8d348-4f47-4473-a117-0c207f685a95 (10e8d348-4f47-4473-a117-0c207f685a95): created successfully Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9ed155-20fc-432d-9624-87b0f319cb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (cf591992-548b-492d-b961-5359261261d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5e774a95-f62e-4277-9e5e-5ab29b42c63a tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created volume successfully. Jul 03 13:03:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating offline snapshot d30052cc-6c66-4bad-b454-e89a7eec78a6 of volume 10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:03:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bee4389-ccdb-49fb-8c38-8d8dd0d5b1d3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:19 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 Jul 03 13:03:19 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:20 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95" returned: 0 in 1.049s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:20 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 1G Jul 03 13:03:20 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:21 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 1G" returned: 0 in 1.177s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e8d348-4f47-4473-a117-0c207f685a95 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:21 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e8d348-4f47-4473-a117-0c207f685a95 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 Jul 03 13:03:21 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:22 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e8d348-4f47-4473-a117-0c207f685a95 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6" returned: 0 in 0.997s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:22 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 is being set with open permissions: ugo+rw Jul 03 13:03:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:22 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 Jul 03 13:03:22 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:23 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6" returned: 0 in 1.033s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:23 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info Jul 03 13:03:23 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-edfdd16a-926c-4c88-ad6f-aab41bad23c6 req-f369c549-76dc-42d6-8096-c87e3b45ed2a tempest-TestMinimumBasicScenario-680502350 None] Terminate volume connection completed successfully. Jul 03 13:03:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-edfdd16a-926c-4c88-ad6f-aab41bad23c6 req-f369c549-76dc-42d6-8096-c87e3b45ed2a tempest-TestMinimumBasicScenario-680502350 None] Deleting attachment abacc658-06aa-4dae-9b71-621f3b8c4dc7. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:03:24 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info" returned: 0 in 1.103s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:24 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info is being set with open permissions: ugo+rw Jul 03 13:03:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:24 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info Jul 03 13:03:24 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:25 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.info" returned: 0 in 0.989s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.547s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0b5b1982-2ed1-493d-9cf8-9f2efab7aa20 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Create snapshot completed successfully Jul 03 13:03:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Acquiring lock "cinder-b38efef5-1e64-456f-8565-fd911d25e1fa-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Lock "cinder-b38efef5-1e64-456f-8565-fd911d25e1fa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Acquiring lock "cinder-quobyte-b38efef5-1e64-456f-8565-fd911d25e1fa" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Lock "cinder-quobyte-b38efef5-1e64-456f-8565-fd911d25e1fa" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f291c2-5cf2-42b7-95bc-24d4bc2aefa0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:27 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa Jul 03 13:03:27 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (0d92e5f3-3b53-485b-8f2d-28156db53f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da6496e-495d-4fd2-ad31-5ae1f6a97aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da6496e-495d-4fd2-ad31-5ae1f6a97aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1364706007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b86015-f401-4a3c-9019-03bb65d34f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:28Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b0bca4-2035-4cc7-ae49-3739801e9f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b0bca4-2035-4cc7-ae49-3739801e9f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d02975c-2a10-4e90-b325-8b8eca3d13e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d02975c-2a10-4e90-b325-8b8eca3d13e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b86015-f401-4a3c-9019-03bb65d34f7f', 'volume_name': 'volume-33b86015-f401-4a3c-9019-03bb65d34f7f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783eeb31-c493-42dc-8436-6ccd4a57f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783eeb31-c493-42dc-8436-6ccd4a57f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557d937c-3ea4-42d8-8380-e03053f4ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume 33b86015-f401-4a3c-9019-03bb65d34f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b86015-f401-4a3c-9019-03bb65d34f7f', 'volume_size': 1} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1364706007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b86015-f401-4a3c-9019-03bb65d34f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:28Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating volume 33b86015-f401-4a3c-9019-03bb65d34f7f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:27 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f 1073741824 Jul 03 13:03:27 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:28 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa" returned: 0 in 1.308s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:28 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa Jul 03 13:03:28 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (31367d5a-7f2c-4f1e-afed-e2fcca09ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029e1eb7-10bd-455a-9315-8215ad6e48bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029e1eb7-10bd-455a-9315-8215ad6e48bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831154378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e45ceda-5434-4a6f-9445-ad49e0462cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:28Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf66461-840f-475d-a91f-3fd6ba6b2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf66461-840f-475d-a91f-3fd6ba6b2153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcea691d-14f8-422d-a9c6-41cbeb3f4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcea691d-14f8-422d-a9c6-41cbeb3f4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e45ceda-5434-4a6f-9445-ad49e0462cd0', 'volume_name': 'volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b07510c-eaf0-4354-88b1-48277e104bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b07510c-eaf0-4354-88b1-48277e104bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d398dd-f146-423d-a3bc-912bcbcde47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume 0e45ceda-5434-4a6f-9445-ad49e0462cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0', 'volume_size': 1} Jul 03 13:03:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (21e7dea0-3dfa-4db3-a88a-84d38732670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b9cd0d-4eda-4729-9c3c-7ac1bb653a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b9cd0d-4eda-4729-9c3c-7ac1bb653a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1515268551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a063bc8-6737-46ce-9424-c8232412626b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:29Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855b216-aefd-4af5-ad47-2e8d8af37b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855b216-aefd-4af5-ad47-2e8d8af37b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593d1e27-a822-43d4-b4e8-ce329d18aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593d1e27-a822-43d4-b4e8-ce329d18aef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a063bc8-6737-46ce-9424-c8232412626b', 'volume_name': 'volume-8a063bc8-6737-46ce-9424-c8232412626b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0e1025-3b6b-4a91-8251-2e38f3cd44e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0e1025-3b6b-4a91-8251-2e38f3cd44e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d1c90b-a09d-493d-a309-f54744a1db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume 8a063bc8-6737-46ce-9424-c8232412626b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a063bc8-6737-46ce-9424-c8232412626b', 'volume_size': 1} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-b38efef5-1e64-456f-8565-fd911d25e1fa" returned: 0 in 1.040s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Lock "cinder-quobyte-b38efef5-1e64-456f-8565-fd911d25e1fa" released by "delete_volume" :: held 2.430s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:29 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f 1073741824" returned: 0 in 1.650s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Created reservations ['b5b7d546-a6ef-4f06-8695-7deef4b02560', 'b750a83f-c5db-4708-8c46-61c500c40eb1', '26daf564-ab82-44dc-b431-3bb091bc9db4', 'fb0b9e1b-38ac-435e-86f4-6e3b55f6f9f5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:29 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f Jul 03 13:03:29 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (589f3e22-a069-4cf0-bd67-7f66688b7749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa8aee1-5fb5-436b-a841-b4e93cd2f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa8aee1-5fb5-436b-a841-b4e93cd2f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014712380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f9a042-5c27-4de0-9ab7-b968ed90662a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:30Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454d6ef2-1351-4d69-bf58-3bac5c196ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454d6ef2-1351-4d69-bf58-3bac5c196ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c9a3fb-6160-4c4d-be97-8a8d109aa9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c9a3fb-6160-4c4d-be97-8a8d109aa9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f9a042-5c27-4de0-9ab7-b968ed90662a', 'volume_name': 'volume-48f9a042-5c27-4de0-9ab7-b968ed90662a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735ac352-89e5-423a-a977-f53dff9174ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735ac352-89e5-423a-a977-f53dff9174ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba062d8-bc54-4755-b95c-2b33fb045781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume 48f9a042-5c27-4de0-9ab7-b968ed90662a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f9a042-5c27-4de0-9ab7-b968ed90662a', 'volume_size': 1} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:29 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:29 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (8a35dc13-4cf0-4531-af48-cf01701274b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473119e5-c530-4ea4-acbb-b018cebfa82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473119e5-c530-4ea4-acbb-b018cebfa82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006927050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256b008d-cf80-4a41-b9f9-41c1b521a3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:30Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e48bd0-9b92-491f-8c77-4fe8a23a5fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e48bd0-9b92-491f-8c77-4fe8a23a5fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7024090-d17a-4466-bf25-4546b7aad012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7024090-d17a-4466-bf25-4546b7aad012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256b008d-cf80-4a41-b9f9-41c1b521a3a3', 'volume_name': 'volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb603f67-85cc-418c-91d2-1d48940919ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb603f67-85cc-418c-91d2-1d48940919ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9731e159-59d5-46b8-9099-7ed4c2dd37c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume 256b008d-cf80-4a41-b9f9-41c1b521a3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3', 'volume_size': 1} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:30 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f" returned: 0 in 1.143s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] <== create_volume: return (2869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.871s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831154378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e45ceda-5434-4a6f-9445-ad49e0462cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:28Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating volume 0e45ceda-5434-4a6f-9445-ad49e0462cd0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:30 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 1073741824 Jul 03 13:03:30 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557d937c-3ea4-42d8-8380-e03053f4ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b86015-f401-4a3c-9019-03bb65d34f7f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0633fdd5-853b-407d-9694-a9382004ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume volume-33b86015-f401-4a3c-9019-03bb65d34f7f (33b86015-f401-4a3c-9019-03bb65d34f7f): created successfully Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0633fdd5-853b-407d-9694-a9382004ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (0d92e5f3-3b53-485b-8f2d-28156db53f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-496e9b9e-eb0c-41ca-9eca-88ceca08040d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created volume successfully. Jul 03 13:03:31 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.291s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:31 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Deleted volume successfully. Jul 03 13:03:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7ab6ef57-35b9-43d1-8633-5b9dba88d43e tempest-TestMinimumBasicScenario-680502350 None] Lock "cinder-b38efef5-1e64-456f-8565-fd911d25e1fa-delete_volume" released by "delete_volume" :: held 4.413s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:31 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 1073741824" returned: 0 in 1.246s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:32 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 Jul 03 13:03:32 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:32 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0" returned: 0 in 0.842s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.508s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1515268551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a063bc8-6737-46ce-9424-c8232412626b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:29Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating volume 8a063bc8-6737-46ce-9424-c8232412626b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:32 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b 1073741824 Jul 03 13:03:32 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d398dd-f146-423d-a3bc-912bcbcde47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56123d3f-f8bc-4234-9bf4-0e10fe073e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 (0e45ceda-5434-4a6f-9445-ad49e0462cd0): created successfully Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56123d3f-f8bc-4234-9bf4-0e10fe073e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (31367d5a-7f2c-4f1e-afed-e2fcca09ef03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a57e6161-c863-4786-823b-527867551a80 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created volume successfully. Jul 03 13:03:33 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b 1073741824" returned: 0 in 1.029s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:33 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b Jul 03 13:03:33 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:34 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.739s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014712380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f9a042-5c27-4de0-9ab7-b968ed90662a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:30Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating volume 48f9a042-5c27-4de0-9ab7-b968ed90662a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:34 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:34 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a 1073741824 Jul 03 13:03:34 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d1c90b-a09d-493d-a309-f54744a1db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a063bc8-6737-46ce-9424-c8232412626b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c23ac5-64a2-4558-9572-5d79c80f181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume volume-8a063bc8-6737-46ce-9424-c8232412626b (8a063bc8-6737-46ce-9424-c8232412626b): created successfully Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c23ac5-64a2-4558-9572-5d79c80f181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (21e7dea0-3dfa-4db3-a88a-84d38732670c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6df17a70-0aab-4cd7-8e8f-31f34492e31e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created volume successfully. Jul 03 13:03:35 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a 1073741824" returned: 0 in 0.896s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:35 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a Jul 03 13:03:35 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:36 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a" returned: 0 in 0.735s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.631s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006927050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256b008d-cf80-4a41-b9f9-41c1b521a3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae20fee73624c0d8c14ae4bbe1b9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:30Z,use_quota=True,user_id='28f3058677434bcebc7e7be5354476d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Creating volume 256b008d-cf80-4a41-b9f9-41c1b521a3a3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:36 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba062d8-bc54-4755-b95c-2b33fb045781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f9a042-5c27-4de0-9ab7-b968ed90662a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:36 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 1073741824 Jul 03 13:03:36 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183781b4-e890-4383-91ad-c4efb2d8e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume volume-48f9a042-5c27-4de0-9ab7-b968ed90662a (48f9a042-5c27-4de0-9ab7-b968ed90662a): created successfully Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183781b4-e890-4383-91ad-c4efb2d8e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (589f3e22-a069-4cf0-bd67-7f66688b7749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ad75efe5-512d-4a87-be0c-5430d42f8861 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created volume successfully. Jul 03 13:03:37 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 1073741824" returned: 0 in 0.986s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:37 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 Jul 03 13:03:37 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:38 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9731e159-59d5-46b8-9099-7ed4c2dd37c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed9d825-0635-4629-9a12-7fac52a1fe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Volume volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 (256b008d-cf80-4a41-b9f9-41c1b521a3a3): created successfully Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed9d825-0635-4629-9a12-7fac52a1fe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Flow 'volume_create_manager' (8a35dc13-4cf0-4531-af48-cf01701274b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8feb9181-d605-4539-9143-ecf14af42b4e tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created volume successfully. Jul 03 13:03:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-256b008d-cf80-4a41-b9f9-41c1b521a3a3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-256b008d-cf80-4a41-b9f9-41c1b521a3a3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-256b008d-cf80-4a41-b9f9-41c1b521a3a3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-256b008d-cf80-4a41-b9f9-41c1b521a3a3" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8538b-b262-43f4-b2a3-9a581530968e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:39 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 Jul 03 13:03:39 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:40 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3" returned: 0 in 0.983s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:40 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3 Jul 03 13:03:40 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:41 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-256b008d-cf80-4a41-b9f9-41c1b521a3a3" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-256b008d-cf80-4a41-b9f9-41c1b521a3a3" released by "delete_volume" :: held 1.808s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['36237d62-3413-49bf-bbba-3e6ed72b247c', '5a1f9685-c027-4b69-b449-414e969df83b', 'c4a7f93d-8d7d-451b-a624-fa8dd97b7da8', 'ac808e42-36db-49d5-9589-cb3070112dce'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:41 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:41 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-48f9a042-5c27-4de0-9ab7-b968ed90662a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-48f9a042-5c27-4de0-9ab7-b968ed90662a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-48f9a042-5c27-4de0-9ab7-b968ed90662a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-48f9a042-5c27-4de0-9ab7-b968ed90662a" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b41dcf-d4a3-444c-9c0c-bfb3c51ac9c0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:41 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a Jul 03 13:03:41 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:42 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.916s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleted volume successfully. Jul 03 13:03:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02b36e3d-f7b5-41f1-8a79-e5487af22101 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-256b008d-cf80-4a41-b9f9-41c1b521a3a3-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:42 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a" returned: 0 in 1.043s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:42 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a Jul 03 13:03:42 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:43 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-48f9a042-5c27-4de0-9ab7-b968ed90662a" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-48f9a042-5c27-4de0-9ab7-b968ed90662a" released by "delete_volume" :: held 1.859s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['7fddb2fe-b3bb-4651-87cf-ce092a260c38', '3601de80-70bd-4008-930a-59c2d45debd6', 'b68c22c6-1e0b-4aab-af8c-191006add121', 'c8bb4169-6c4d-412d-9c1f-d087ddb242aa'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:43 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:43 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-8a063bc8-6737-46ce-9424-c8232412626b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-8a063bc8-6737-46ce-9424-c8232412626b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-8a063bc8-6737-46ce-9424-c8232412626b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-8a063bc8-6737-46ce-9424-c8232412626b" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce6021-9c7b-43ab-9e80-c8a9d9d2bfc3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:44 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b Jul 03 13:03:44 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:44 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.807s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleted volume successfully. Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-db71ad97-7a26-4142-922a-80459bd221d2 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-48f9a042-5c27-4de0-9ab7-b968ed90662a-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b" returned: 0 in 0.906s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:44 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:44 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b Jul 03 13:03:44 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:45 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8a063bc8-6737-46ce-9424-c8232412626b" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-8a063bc8-6737-46ce-9424-c8232412626b" released by "delete_volume" :: held 1.719s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['e9550ff9-9ca6-401f-baf9-45316c0078d4', '59d568ec-1155-4d7a-8144-2988ef319495', '541a9bcc-1480-4272-a19c-6089a293b8f6', '01c10ddf-0e5f-4f51-a2e2-1801f45ab7d1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:45 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:45 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-0e45ceda-5434-4a6f-9445-ad49e0462cd0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-0e45ceda-5434-4a6f-9445-ad49e0462cd0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-0e45ceda-5434-4a6f-9445-ad49e0462cd0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-0e45ceda-5434-4a6f-9445-ad49e0462cd0" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e46fa3-a8fa-4668-9081-3f9b1c41ced1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:46 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 Jul 03 13:03:46 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:46 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleted volume successfully. Jul 03 13:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-336ef118-0645-46a2-ad32-f7931b462661 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-8a063bc8-6737-46ce-9424-c8232412626b-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:47 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:47 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0 Jul 03 13:03:47 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:48 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e45ceda-5434-4a6f-9445-ad49e0462cd0" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-0e45ceda-5434-4a6f-9445-ad49e0462cd0" released by "delete_volume" :: held 1.773s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['8296e02d-c9db-4f22-a1ca-acbba1048e42', '5c44c4cb-b8e4-4b81-82f5-ec703b5df331', '52a03069-86cd-4f80-b714-4dd97f8e614b', '695104ec-6c03-4ee7-ab24-066ff4fb5ab1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:48 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:48 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-33b86015-f401-4a3c-9019-03bb65d34f7f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-33b86015-f401-4a3c-9019-03bb65d34f7f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-33b86015-f401-4a3c-9019-03bb65d34f7f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-33b86015-f401-4a3c-9019-03bb65d34f7f" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc376049-dcfd-498c-9c4d-6891d61bc1d8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:48 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f Jul 03 13:03:48 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:49 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.779s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:49 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleted volume successfully. Jul 03 13:03:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34da4a03-d23f-49c3-be70-540182e827fb tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-0e45ceda-5434-4a6f-9445-ad49e0462cd0-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:49 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f" returned: 0 in 1.002s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:49 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f Jul 03 13:03:49 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:50 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-33b86015-f401-4a3c-9019-03bb65d34f7f" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-33b86015-f401-4a3c-9019-03bb65d34f7f" released by "delete_volume" :: held 1.839s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['47d83c23-7a42-4e6b-9054-3e50d2b01835', '64ab3ba4-66d0-414d-b37c-7199978f57f8', '6f6145a5-82c6-4ac0-b9c7-6ed6e48000ca', 'ad71731f-d96d-441f-b013-a2d85f73268c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:50 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:50 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-d30052cc-6c66-4bad-b454-e89a7eec78a6-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-d30052cc-6c66-4bad-b454-e89a7eec78a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-10e8d348-4f47-4473-a117-0c207f685a95" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-10e8d348-4f47-4473-a117-0c207f685a95" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-d30052cc-6c66-4bad-b454-e89a7eec78a6" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-d30052cc-6c66-4bad-b454-e89a7eec78a6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleting offline snapshot d30052cc-6c66-4bad-b454-e89a7eec78a6 of volume 10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] snapshot_file for this snap is: volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[be272ac4-a275-4f92-ac35-10ebce20c1ac]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:51 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 Jul 03 13:03:51 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:51 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.699s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleted volume successfully. Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8a374e5c-9a96-4361-b43c-b084e76f912d tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-33b86015-f401-4a3c-9019-03bb65d34f7f-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:51 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e8d348-4f47-4473-a117-0c207f685a95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7133f3e1-9b6a-4531-8267-8b0855f92d0d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:51 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 Jul 03 13:03:51 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:52 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:52 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 Jul 03 13:03:52 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:53 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:53 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6 Jul 03 13:03:53 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:54 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95.d30052cc-6c66-4bad-b454-e89a7eec78a6" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-d30052cc-6c66-4bad-b454-e89a7eec78a6" released by "_delete_snapshot" :: held 3.357s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-10e8d348-4f47-4473-a117-0c207f685a95" released by "delete_snapshot" :: held 3.380s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:54 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['9b7b654d-d023-40cb-bbda-cc3395c497e8', '22008ad1-da98-4992-9e38-1c60ec2d89cb', 'a5da5835-4175-40d1-9197-26d3c692d4fd', '2d4dd789-7acf-4afe-ac75-a037da1d5ec3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Delete snapshot completed successfully. Jul 03 13:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f80e332f-d1b1-45e2-a184-57b8e1007496 tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-d30052cc-6c66-4bad-b454-e89a7eec78a6-delete_snapshot" released by "delete_snapshot" :: held 3.559s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-10e8d348-4f47-4473-a117-0c207f685a95-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-10e8d348-4f47-4473-a117-0c207f685a95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "cinder-quobyte-10e8d348-4f47-4473-a117-0c207f685a95" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-10e8d348-4f47-4473-a117-0c207f685a95" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd78da7-f763-42e7-897c-d5d084dc9575]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:55 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 Jul 03 13:03:55 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Flow 'volume_create_manager' (8a35686c-0fb6-40ca-af09-d2c67c7ddc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab97f4dd-61a3-458a-bde3-ea0a630e61c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab97f4dd-61a3-458a-bde3-ea0a630e61c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963474ba-105e-42d1-a5ec-4565c07ed908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a2a1b4cb4846a49d4b38cc351b78f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:56Z,use_quota=True,user_id='c4ed240dcb19401294808d70083fae16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8ff6137-7fd6-49bb-8b31-fb7de5d068c9),volume_type_id=d8ff6137-7fd6-49bb-8b31-fb7de5d068c9)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa91e31-ed25-4131-9b80-df8c69e7c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa91e31-ed25-4131-9b80-df8c69e7c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4bd87-0143-4be4-b389-ee04a097a0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:55 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4bd87-0143-4be4-b389-ee04a097a0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '963474ba-105e-42d1-a5ec-4565c07ed908', 'volume_name': 'volume-963474ba-105e-42d1-a5ec-4565c07ed908', 'volume_size': 1, 'image_id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '636ea523b0e66d79840dd3687de1482e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '76a2a1b4cb4846a49d4b38cc351b78f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3421e2f7b9cd16c202c753fb93c48991bbf404ed54a9092de34e945f85c92686d48f165f012a38a6af57d0c5e702ab55fd19826f26344a1a4ad30b2ac4c034b', 'id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'created_at': datetime.datetime(2026, 7, 3, 11, 3, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 3, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771f3e90-fbf2-4709-9470-ee296ab47e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771f3e90-fbf2-4709-9470-ee296ab47e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86560b88-5957-4390-ad73-7f8e8200e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:03:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Volume 963474ba-105e-42d1-a5ec-4565c07ed908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-963474ba-105e-42d1-a5ec-4565c07ed908', 'volume_size': 1, 'image_id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '636ea523b0e66d79840dd3687de1482e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '76a2a1b4cb4846a49d4b38cc351b78f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3421e2f7b9cd16c202c753fb93c48991bbf404ed54a9092de34e945f85c92686d48f165f012a38a6af57d0c5e702ab55fd19826f26344a1a4ad30b2ac4c034b', 'id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'created_at': datetime.datetime(2026, 7, 3, 11, 3, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 3, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Trying to clone 963474ba-105e-42d1-a5ec-4565c07ed908 from image b868ffeb-3b4f-46b0-817d-d00cfea40ef8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:03:56 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:56 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95 Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:03:56 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:56 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Image download 0.00 MB at 0.00 MB/s Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa88bcc2-fdc9-4d65-afb0-292a0cc14495]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:56 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD Jul 03 13:03:56 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:56 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10e8d348-4f47-4473-a117-0c207f685a95" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-quobyte-10e8d348-4f47-4473-a117-0c207f685a95" released by "delete_volume" :: held 1.733s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Created reservations ['6a56a495-55ab-45ee-a68e-092582c9cc16', '1b6a7973-46b9-4a22-991f-0ecff4732bd6', '206b47d4-af0e-4208-995f-359c9f4fb864', '0f89af58-9e93-4432-922b-200906d0c455'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:57 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:57 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:03:57 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:57 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD Jul 03 13:03:57 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:57 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:03:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Deleted volume successfully. Jul 03 13:03:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b2ca83ab-be53-46c5-9f0d-e9186eb15e8c tempest-CreateVolumesFromSnapshotTest-1883907107 None] Lock "cinder-10e8d348-4f47-4473-a117-0c207f685a95-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:03:58 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD" returned: 1 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Temporary image b868ffeb-3b4f-46b0-817d-d00cfea40ef8 is fetched for user c4ed240dcb19401294808d70083fae16. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5bcf9-2414-4c64-ac7c-382f49751a2c]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:58 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD Jul 03 13:03:58 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:58 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:59 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD Jul 03 13:03:59 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:03:59 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD" returned: 1 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963474ba-105e-42d1-a5ec-4565c07ed908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a2a1b4cb4846a49d4b38cc351b78f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:56Z,use_quota=True,user_id='c4ed240dcb19401294808d70083fae16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8ff6137-7fd6-49bb-8b31-fb7de5d068c9),volume_type_id=d8ff6137-7fd6-49bb-8b31-fb7de5d068c9)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Creating volume 963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:03:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:03:59 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 1073741824 Jul 03 13:03:59 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:00 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 1073741824" returned: 0 in 0.994s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:00 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:00 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:01 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Attempting download of b868ffeb-3b4f-46b0-817d-d00cfea40ef8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'metadata': {}}])) to volume 963474ba-105e-42d1-a5ec-4565c07ed908. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe52aa3-fb87-4844-a2b4-47e7c322d5f2]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:01 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g Jul 03 13:04:01 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:02 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:02 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:02 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:02 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:02 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g Jul 03 13:04:02 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:03 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g" returned: 1 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_5i3uqm9g' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:04:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2683eb-ff18-4950-a1f9-2ebc2708384f]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:03 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD Jul 03 13:04:03 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:04 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:04 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD Jul 03 13:04:04 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:05 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD" returned: 1 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] b868ffeb-3b4f-46b0-817d-d00cfea40ef8 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:05 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:05 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:05 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 0 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b868ffeb-3b4f-46b0-817d-d00cfea40ef8_yfgdjnyodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:04:05 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 13:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:05 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 1G Jul 03 13:04:05 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:06 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 1G" returned: 0 in 0.816s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[00345b64-fb20-453f-b8f9-616542b5095a]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:06 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:06 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:07 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:07 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:07 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 1 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Downloaded image b868ffeb-3b4f-46b0-817d-d00cfea40ef8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'metadata': {}}])) to volume 963474ba-105e-42d1-a5ec-4565c07ed908 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:04:08 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Temporary image b868ffeb-3b4f-46b0-817d-d00cfea40ef8 for user c4ed240dcb19401294808d70083fae16 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Marking volume 963474ba-105e-42d1-a5ec-4565c07ed908 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=108,cinder:DELETE=12,cinder:SELECT=71,cinder:INSERT=28 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Copying metadata from image b868ffeb-3b4f-46b0-817d-d00cfea40ef8 to 963474ba-105e-42d1-a5ec-4565c07ed908. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Creating volume glance metadata for volume 963474ba-105e-42d1-a5ec-4565c07ed908 backed by image b868ffeb-3b4f-46b0-817d-d00cfea40ef8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '636ea523b0e66d79840dd3687de1482e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=83,cinder:UPDATE=107,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86560b88-5957-4390-ad73-7f8e8200e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963474ba-105e-42d1-a5ec-4565c07ed908', 'volume_size': 1, 'image_id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '636ea523b0e66d79840dd3687de1482e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '76a2a1b4cb4846a49d4b38cc351b78f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3421e2f7b9cd16c202c753fb93c48991bbf404ed54a9092de34e945f85c92686d48f165f012a38a6af57d0c5e702ab55fd19826f26344a1a4ad30b2ac4c034b', 'id': 'b868ffeb-3b4f-46b0-817d-d00cfea40ef8', 'created_at': datetime.datetime(2026, 7, 3, 11, 3, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 3, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b868ffeb-3b4f-46b0-817d-d00cfea40ef8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da65bbb2-cc34-4221-ae86-94e08ad155d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Volume volume-963474ba-105e-42d1-a5ec-4565c07ed908 (963474ba-105e-42d1-a5ec-4565c07ed908): created successfully Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da65bbb2-cc34-4221-ae86-94e08ad155d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Flow 'volume_create_manager' (8a35686c-0fb6-40ca-af09-d2c67c7ddc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b6c889f7-cd8a-4dff-ab8d-f8c6f87058cd tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Created volume successfully. Jul 03 13:04:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Acquiring lock "cinder-963474ba-105e-42d1-a5ec-4565c07ed908-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "cinder-963474ba-105e-42d1-a5ec-4565c07ed908-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Acquiring lock "cinder-quobyte-963474ba-105e-42d1-a5ec-4565c07ed908" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "cinder-quobyte-963474ba-105e-42d1-a5ec-4565c07ed908" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f171f439-e435-478b-af98-c4e21ba66ab2]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:09 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:09 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:10 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 0 in 0.839s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:10 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:10 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:11 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 1 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:11 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908 Jul 03 13:04:11 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:12 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-963474ba-105e-42d1-a5ec-4565c07ed908" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "cinder-quobyte-963474ba-105e-42d1-a5ec-4565c07ed908" released by "delete_volume" :: held 2.374s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:12 devstack cinder-volume[86966]: WARNING cinder.quota [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:04:12 devstack cinder-volume[86966]: WARNING cinder.quota [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Created reservations ['b24fb3f0-be10-45ad-9e3b-0b009cd3f09c', 'bc2fa227-642f-4224-9e18-191ec7fb4047', '36d04869-30fb-45be-8e1a-223ef710d0fb', '8cde1095-c44a-492f-ae5b-ce9cc0178d95'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:12 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:12 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:13 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.688s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Deleted volume successfully. Jul 03 13:04:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f1bb206-cd9c-4230-9d3d-6fde9ec57365 tempest-VolumeAndVolumeTypeFromImageTest-1568002019 None] Lock "cinder-963474ba-105e-42d1-a5ec-4565c07ed908-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:17 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (ad6cb081-5b8e-4908-a1a1-e75d9620504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234bea0-62eb-4770-a4cd-126ce4c7d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234bea0-62eb-4770-a4cd-126ce4c7d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092476237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998e4c69-64f1-46b9-b13a-b041aa600be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:18Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a764903f-0ae8-4b5f-91bc-06a4d98476bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a764903f-0ae8-4b5f-91bc-06a4d98476bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f200d7-cd3f-4484-9e61-59841c098e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f200d7-cd3f-4484-9e61-59841c098e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998e4c69-64f1-46b9-b13a-b041aa600be8', 'volume_name': 'volume-998e4c69-64f1-46b9-b13a-b041aa600be8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481985ed-13a0-44ad-a381-6fbbf2d64e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481985ed-13a0-44ad-a381-6fbbf2d64e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3245727-d2d1-4e44-9fb7-756e6dc8a4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Volume 998e4c69-64f1-46b9-b13a-b041aa600be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998e4c69-64f1-46b9-b13a-b041aa600be8', 'volume_size': 1} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092476237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998e4c69-64f1-46b9-b13a-b041aa600be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:18Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Creating volume 998e4c69-64f1-46b9-b13a-b041aa600be8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:18 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 1073741824 Jul 03 13:04:18 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (b6f12b4b-b82e-4bd7-8b27-b98518c42b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa1099f-6ed6-464f-8d4d-517068845203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa1099f-6ed6-464f-8d4d-517068845203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-804268064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f89aec-677b-4d28-81bd-05a5184eba5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:18Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a4d809-c101-43b3-810f-396119066711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a4d809-c101-43b3-810f-396119066711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13870cc3-108e-48ec-92ab-74c77efce5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13870cc3-108e-48ec-92ab-74c77efce5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f89aec-677b-4d28-81bd-05a5184eba5b', 'volume_name': 'volume-29f89aec-677b-4d28-81bd-05a5184eba5b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abd5bdf-9c8f-4749-8ad9-b8a3eddef07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abd5bdf-9c8f-4749-8ad9-b8a3eddef07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af35160-6561-4847-a70a-9f76e0d875e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Volume 29f89aec-677b-4d28-81bd-05a5184eba5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f89aec-677b-4d28-81bd-05a5184eba5b', 'volume_size': 1} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (8b4c5db2-ff21-4f77-bf49-59b90f2b84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7c4a8b-b7f6-48b0-8214-01448fa7bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7c4a8b-b7f6-48b0-8214-01448fa7bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187914202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc65f485-3263-4e15-9590-1aa297d98b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:19Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a255387-41ba-484b-a929-e968e880f1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a255387-41ba-484b-a929-e968e880f1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ded959-79a7-4f5e-b1d3-9b63f487000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ded959-79a7-4f5e-b1d3-9b63f487000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc65f485-3263-4e15-9590-1aa297d98b27', 'volume_name': 'volume-bc65f485-3263-4e15-9590-1aa297d98b27', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1b6de4-40aa-44b7-aa25-a0dce5e97a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1b6de4-40aa-44b7-aa25-a0dce5e97a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a7ed14-97b2-47f0-9f27-10b30cdf94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Volume bc65f485-3263-4e15-9590-1aa297d98b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc65f485-3263-4e15-9590-1aa297d98b27', 'volume_size': 1} Jul 03 13:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:19 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 1073741824" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:19 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 Jul 03 13:04:19 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (ecf56e33-306c-4cec-b03a-1dbb6889389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420745d8-bc24-4bb4-b3ee-8d79e628c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420745d8-bc24-4bb4-b3ee-8d79e628c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947993413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:19Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33735cf8-613f-471c-9160-db3c0d22d82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33735cf8-613f-471c-9160-db3c0d22d82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c72f1d-213f-4f5a-9e0b-9c8be940aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c72f1d-213f-4f5a-9e0b-9c8be940aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60ec8e6-cab8-4f9f-92aa-fbffdf1a254a', 'volume_name': 'volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c97e78-ec01-46f0-998e-f3ab170461d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c97e78-ec01-46f0-998e-f3ab170461d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10fa676-1332-4e96-ba05-fa771b40ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Volume d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a', 'volume_size': 1} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (71a6f7d2-bc5f-4d05-84ed-b5dd45bd2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449595e1-ac3d-4056-87c2-189a739bd23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449595e1-ac3d-4056-87c2-189a739bd23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1457502269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c72b6f-1080-416a-b611-7f32303984f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:20Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379630dd-3945-4bab-8c78-c009f60495f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379630dd-3945-4bab-8c78-c009f60495f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d33faf-7427-430c-8493-0310eb57c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d33faf-7427-430c-8493-0310eb57c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c72b6f-1080-416a-b611-7f32303984f6', 'volume_name': 'volume-93c72b6f-1080-416a-b611-7f32303984f6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c335a2-6b90-42d6-b3b9-b0aa44704e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c335a2-6b90-42d6-b3b9-b0aa44704e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2dd063-4949-4466-9d84-d67023e26a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Volume 93c72b6f-1080-416a-b611-7f32303984f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c72b6f-1080-416a-b611-7f32303984f6', 'volume_size': 1} Jul 03 13:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:20 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8" returned: 0 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-804268064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f89aec-677b-4d28-81bd-05a5184eba5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:18Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Creating volume 29f89aec-677b-4d28-81bd-05a5184eba5b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:20 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:20 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b 1073741824 Jul 03 13:04:20 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3245727-d2d1-4e44-9fb7-756e6dc8a4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998e4c69-64f1-46b9-b13a-b041aa600be8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa1e8e1-aa23-491d-aaaa-dcf839265365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Volume volume-998e4c69-64f1-46b9-b13a-b041aa600be8 (998e4c69-64f1-46b9-b13a-b041aa600be8): created successfully Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa1e8e1-aa23-491d-aaaa-dcf839265365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (ad6cb081-5b8e-4908-a1a1-e75d9620504d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dbfde9c0-fc44-4adb-8e8a-86933cb1b601 tempest-CreateVolumesFromImageTest-1547121991 None] Created volume successfully. Jul 03 13:04:21 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b 1073741824" returned: 0 in 0.989s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:21 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b Jul 03 13:04:21 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:21 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b" returned: 0 in 0.780s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187914202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc65f485-3263-4e15-9590-1aa297d98b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:19Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Creating volume bc65f485-3263-4e15-9590-1aa297d98b27 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:21 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:21 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 1073741824 Jul 03 13:04:21 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af35160-6561-4847-a70a-9f76e0d875e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f89aec-677b-4d28-81bd-05a5184eba5b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d72c2e9-c738-4106-a0c8-6d9f0c37f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Volume volume-29f89aec-677b-4d28-81bd-05a5184eba5b (29f89aec-677b-4d28-81bd-05a5184eba5b): created successfully Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d72c2e9-c738-4106-a0c8-6d9f0c37f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (b6f12b4b-b82e-4bd7-8b27-b98518c42b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dbd8260c-5a07-4c05-bd18-6355c43cddb5 tempest-CreateVolumesFromImageTest-1547121991 None] Created volume successfully. Jul 03 13:04:22 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 1073741824" returned: 0 in 0.906s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:22 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 Jul 03 13:04:22 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:23 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27" returned: 0 in 0.696s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.095s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947993413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:19Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Creating volume d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:23 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:23 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a 1073741824 Jul 03 13:04:23 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a7ed14-97b2-47f0-9f27-10b30cdf94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc65f485-3263-4e15-9590-1aa297d98b27', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa640fd-2031-4b30-8e67-3bb2aaf90fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:23 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Volume volume-bc65f485-3263-4e15-9590-1aa297d98b27 (bc65f485-3263-4e15-9590-1aa297d98b27): created successfully Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa640fd-2031-4b30-8e67-3bb2aaf90fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (8b4c5db2-ff21-4f77-bf49-59b90f2b84cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5d361c77-838c-4fcb-90da-ef7137087932 tempest-CreateVolumesFromImageTest-1547121991 None] Created volume successfully. Jul 03 13:04:24 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a 1073741824" returned: 0 in 0.842s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:24 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a Jul 03 13:04:24 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:25 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a" returned: 0 in 0.659s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.332s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1457502269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c72b6f-1080-416a-b611-7f32303984f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023f82f825984e86b3883862f4e27735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:20Z,use_quota=True,user_id='4ea113f34c8846c59fe2bcec3f108940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Creating volume 93c72b6f-1080-416a-b611-7f32303984f6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:25 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10fa676-1332-4e96-ba05-fa771b40ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:25 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 1073741824 Jul 03 13:04:25 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8ebc9b-5416-41b4-b581-7626c54d34a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Volume volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a (d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a): created successfully Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8ebc9b-5416-41b4-b581-7626c54d34a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (ecf56e33-306c-4cec-b03a-1dbb6889389a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-98189109-435c-4d7d-a4f8-7de4049dca50 tempest-CreateVolumesFromImageTest-1547121991 None] Created volume successfully. Jul 03 13:04:25 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 1073741824" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:25 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 Jul 03 13:04:25 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:26 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2dd063-4949-4466-9d84-d67023e26a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c72b6f-1080-416a-b611-7f32303984f6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36870091-4aa2-4441-b6cf-568026f14c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Volume volume-93c72b6f-1080-416a-b611-7f32303984f6 (93c72b6f-1080-416a-b611-7f32303984f6): created successfully Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36870091-4aa2-4441-b6cf-568026f14c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Flow 'volume_create_manager' (71a6f7d2-bc5f-4d05-84ed-b5dd45bd2753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-343071c2-13e7-4495-80df-776f340389a1 tempest-CreateVolumesFromImageTest-1547121991 None] Created volume successfully. Jul 03 13:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-93c72b6f-1080-416a-b611-7f32303984f6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-93c72b6f-1080-416a-b611-7f32303984f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-quobyte-93c72b6f-1080-416a-b611-7f32303984f6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-93c72b6f-1080-416a-b611-7f32303984f6" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fbc3f4-e86d-4213-ad2a-6fa233e9df46]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:27 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 Jul 03 13:04:27 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:28 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:28 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6 Jul 03 13:04:28 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:29 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-93c72b6f-1080-416a-b611-7f32303984f6" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-93c72b6f-1080-416a-b611-7f32303984f6" released by "delete_volume" :: held 1.751s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Created reservations ['167f3e09-1a39-408a-bb86-e788f453d229', '126e345f-c3c5-492b-ae31-44beb6adfdf4', 'f31903e3-e23f-4866-960c-495753a4471b', '3c26f1cd-fddc-4191-a37d-977dded0bef0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:29 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:29 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-quobyte-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d2d8fd-20b3-4926-b5c9-7632345fcf95]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:29 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a Jul 03 13:04:29 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:30 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.697s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Deleted volume successfully. Jul 03 13:04:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-df88c033-da3a-4bce-b729-d0d7ef16da2a tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-93c72b6f-1080-416a-b611-7f32303984f6-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:30 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a" returned: 0 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:30 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a Jul 03 13:04:30 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:31 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a" returned: 0 in 0.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a" released by "delete_volume" :: held 1.587s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Created reservations ['ee1f430e-b313-40b5-b84e-8f7633b9560c', '38dea050-ef01-4a72-b36d-23ffa2010194', '55e16610-1146-48ce-94d7-aa586201b0ed', '3c329de7-ff3b-4008-be12-388d575be0d0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:31 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:31 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-bc65f485-3263-4e15-9590-1aa297d98b27-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-bc65f485-3263-4e15-9590-1aa297d98b27-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-quobyte-bc65f485-3263-4e15-9590-1aa297d98b27" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-bc65f485-3263-4e15-9590-1aa297d98b27" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d46b1-90c5-4cd1-8d95-a9d9575af9fd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:32 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.718s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Deleted volume successfully. Jul 03 13:04:32 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 Jul 03 13:04:32 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-714b9a7f-4f25-4084-b728-1b9d5dd71a89 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-d60ec8e6-cab8-4f9f-92aa-fbffdf1a254a-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:32 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:32 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27 Jul 03 13:04:32 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:33 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc65f485-3263-4e15-9590-1aa297d98b27" returned: 0 in 0.676s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-bc65f485-3263-4e15-9590-1aa297d98b27" released by "delete_volume" :: held 1.531s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Created reservations ['7fb57d0d-1d31-4825-b6f4-0e2be656a883', 'c2ac3396-57c6-48f6-abeb-30ea20d9d28c', '1cf64767-30c4-40bd-97c7-cf7d83a19b0e', 'c96e4994-8d69-470d-ac03-e58977f825a8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:33 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:33 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-29f89aec-677b-4d28-81bd-05a5184eba5b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-29f89aec-677b-4d28-81bd-05a5184eba5b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-quobyte-29f89aec-677b-4d28-81bd-05a5184eba5b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-29f89aec-677b-4d28-81bd-05a5184eba5b" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[648453a8-57df-4406-9faf-0f481f04adb9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:34 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.656s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Deleted volume successfully. Jul 03 13:04:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e8289f5-0a46-4f45-8930-9374e86be21c tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-bc65f485-3263-4e15-9590-1aa297d98b27-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:34 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b Jul 03 13:04:34 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:35 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:35 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b Jul 03 13:04:35 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:35 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-29f89aec-677b-4d28-81bd-05a5184eba5b" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-29f89aec-677b-4d28-81bd-05a5184eba5b" released by "delete_volume" :: held 1.509s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Created reservations ['0cc22750-f055-47a8-85a6-0c9a4b0530eb', '8ad0438d-fe27-4b03-a6c3-0cf83eb42d60', '6c767134-7e72-43ca-9107-d9c02ecc5574', '652a3005-d478-4aba-b1b2-a3a1a319fb8e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:35 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:35 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-998e4c69-64f1-46b9-b13a-b041aa600be8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-998e4c69-64f1-46b9-b13a-b041aa600be8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "cinder-quobyte-998e4c69-64f1-46b9-b13a-b041aa600be8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-998e4c69-64f1-46b9-b13a-b041aa600be8" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[03102779-18a5-435f-8756-82bd87fbf57e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:36 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.708s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Deleted volume successfully. Jul 03 13:04:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09f18edd-4f69-42ed-bbcc-a1798b9942c5 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-29f89aec-677b-4d28-81bd-05a5184eba5b-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:36 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 Jul 03 13:04:36 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:37 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8" returned: 0 in 0.809s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:37 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8 Jul 03 13:04:37 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:38 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-998e4c69-64f1-46b9-b13a-b041aa600be8" returned: 0 in 0.704s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-quobyte-998e4c69-64f1-46b9-b13a-b041aa600be8" released by "delete_volume" :: held 1.562s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Created reservations ['1f664b89-54f8-4f8a-ac22-bf553345d7a7', 'f1b8b7b3-7e01-4744-a4d0-686fb5e57ebb', '1c423158-c41e-47f4-9cd5-d8660e3c51d5', '4d969449-8636-43e3-9ed6-34b40f0c6422'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:38 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:38 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:39 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.721s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:39 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Deleted volume successfully. Jul 03 13:04:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3de5e276-25f2-414b-93e7-47ba468f99b8 tempest-CreateVolumesFromImageTest-1547121991 None] Lock "cinder-998e4c69-64f1-46b9-b13a-b041aa600be8-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (f5a62a19-ded5-4770-bc61-af9b13a93628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25456a41-405f-4ccc-b0b0-5bb5893f4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25456a41-405f-4ccc-b0b0-5bb5893f4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-217334236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce126194-cb95-4fc0-8b7f-777df24b8523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:42Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94da7ee-09f6-4294-8a05-2965fc4fb65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94da7ee-09f6-4294-8a05-2965fc4fb65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efddc5ec-fe98-4bda-a455-180214e5e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efddc5ec-fe98-4bda-a455-180214e5e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce126194-cb95-4fc0-8b7f-777df24b8523', 'volume_name': 'volume-ce126194-cb95-4fc0-8b7f-777df24b8523', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d8fbce-c7cb-4cbd-b599-fe701e6b3d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d8fbce-c7cb-4cbd-b599-fe701e6b3d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff82d4e-374d-4039-be85-245e727acc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume ce126194-cb95-4fc0-8b7f-777df24b8523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce126194-cb95-4fc0-8b7f-777df24b8523', 'volume_size': 1} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-217334236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce126194-cb95-4fc0-8b7f-777df24b8523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:42Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Creating volume ce126194-cb95-4fc0-8b7f-777df24b8523 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:42 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:42 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 1073741824 Jul 03 13:04:42 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:43 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 1073741824" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:43 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 Jul 03 13:04:43 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:44 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523" returned: 0 in 0.903s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff82d4e-374d-4039-be85-245e727acc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce126194-cb95-4fc0-8b7f-777df24b8523', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8ed62d-e5e2-4d9c-b7e9-38e938231458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume volume-ce126194-cb95-4fc0-8b7f-777df24b8523 (ce126194-cb95-4fc0-8b7f-777df24b8523): created successfully Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8ed62d-e5e2-4d9c-b7e9-38e938231458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (f5a62a19-ded5-4770-bc61-af9b13a93628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-73b7cebf-f986-4a68-bd0b-2d0087672d7f tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created volume successfully. Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (fce189b5-35bc-42b0-ad7a-f46f128e4b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c174b1-ae47-47f0-a701-5baf1b98e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c174b1-ae47-47f0-a701-5baf1b98e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046234199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d303875-c97c-4b41-b722-5d9b57d68049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:46Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410d1529-c665-4cd4-8b48-44fa3d91f0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410d1529-c665-4cd4-8b48-44fa3d91f0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa25209-88dc-44f3-8282-8c1577c69487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa25209-88dc-44f3-8282-8c1577c69487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d303875-c97c-4b41-b722-5d9b57d68049', 'volume_name': 'volume-4d303875-c97c-4b41-b722-5d9b57d68049', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ddc39-80cc-42ae-843c-7a152938eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ddc39-80cc-42ae-843c-7a152938eb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaae26c-92b0-4ecd-8d4c-dca0e8d7b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume 4d303875-c97c-4b41-b722-5d9b57d68049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d303875-c97c-4b41-b722-5d9b57d68049', 'volume_size': 1} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046234199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d303875-c97c-4b41-b722-5d9b57d68049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:46Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Creating volume 4d303875-c97c-4b41-b722-5d9b57d68049 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:46 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 1073741824 Jul 03 13:04:46 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (0be756e2-c2bc-4235-8471-067de9bfd23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2131e4-97b8-4021-a75b-a81d8d8dd214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2131e4-97b8-4021-a75b-a81d8d8dd214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-484611970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d870c67-7b5a-4fab-a6d0-ab2016919db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:46Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f975fd6-2ad7-4dc1-8155-36c094c7f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f975fd6-2ad7-4dc1-8155-36c094c7f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a07d15-e12f-436b-999f-d6812a2b7538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a07d15-e12f-436b-999f-d6812a2b7538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d870c67-7b5a-4fab-a6d0-ab2016919db8', 'volume_name': 'volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28df5a16-b26a-4ec6-9118-7afe74678e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28df5a16-b26a-4ec6-9118-7afe74678e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee168e40-2318-4e7c-b04e-afa7496d8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume 8d870c67-7b5a-4fab-a6d0-ab2016919db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8', 'volume_size': 1} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (9b7c298f-6eb6-45e2-8a8e-8c0f309d0328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd225bf-ca51-4c6d-8263-62e2d6c4b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd225bf-ca51-4c6d-8263-62e2d6c4b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174864482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c158825c-30ec-44fb-9ab9-b65619243aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:47Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25e255b-2ba1-4d56-9f67-07ff07cab674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25e255b-2ba1-4d56-9f67-07ff07cab674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06e49f4-090b-4928-ada1-83de0fd1fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06e49f4-090b-4928-ada1-83de0fd1fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c158825c-30ec-44fb-9ab9-b65619243aae', 'volume_name': 'volume-c158825c-30ec-44fb-9ab9-b65619243aae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531b1bf2-26c9-424e-a88c-cf7eee82cc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531b1bf2-26c9-424e-a88c-cf7eee82cc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb9cf80-aa98-4f14-bf45-a75c1cd2305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume c158825c-30ec-44fb-9ab9-b65619243aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c158825c-30ec-44fb-9ab9-b65619243aae', 'volume_size': 1} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:47 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 1073741824" returned: 0 in 1.115s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (21f89619-164d-497d-802d-d368c6ef27af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c71c51-1e9b-471b-9c87-2a166ff8a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c71c51-1e9b-471b-9c87-2a166ff8a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497629204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b38d38-7e3d-4124-9faf-03ede9908f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:47Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 Jul 03 13:04:47 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2e9084-453b-4b73-8171-b5b4d1a88ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2e9084-453b-4b73-8171-b5b4d1a88ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdab287-09ee-4e18-8c31-39a7b56fc8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdab287-09ee-4e18-8c31-39a7b56fc8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b38d38-7e3d-4124-9faf-03ede9908f39', 'volume_name': 'volume-75b38d38-7e3d-4124-9faf-03ede9908f39', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6cdb35-b072-4301-abdb-e16b081b6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6cdb35-b072-4301-abdb-e16b081b6454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6450d5c2-4ab5-4622-81b3-5ffdceddace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume 75b38d38-7e3d-4124-9faf-03ede9908f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b38d38-7e3d-4124-9faf-03ede9908f39', 'volume_size': 1} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (af240667-aaed-49af-997c-4ae88cfe7c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcf6445-e81e-4464-8bb4-f71a6fd4e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcf6445-e81e-4464-8bb4-f71a6fd4e823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404503792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756eeb0f-a4a4-4bc5-8328-0b8a7974697d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:48Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f6ed4-e2e9-4d3d-ad66-b421578791f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f6ed4-e2e9-4d3d-ad66-b421578791f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7442e3d9-7c82-423f-a78a-6f40193d083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7442e3d9-7c82-423f-a78a-6f40193d083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756eeb0f-a4a4-4bc5-8328-0b8a7974697d', 'volume_name': 'volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0e314a-3be9-46be-b1de-c97808e9f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0e314a-3be9-46be-b1de-c97808e9f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d942d4d-93a6-4786-96fb-e44f7447a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume 756eeb0f-a4a4-4bc5-8328-0b8a7974697d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d', 'volume_size': 1} Jul 03 13:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:48 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-484611970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d870c67-7b5a-4fab-a6d0-ab2016919db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:46Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Creating volume 8d870c67-7b5a-4fab-a6d0-ab2016919db8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:48 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 1073741824 Jul 03 13:04:48 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaae26c-92b0-4ecd-8d4c-dca0e8d7b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d303875-c97c-4b41-b722-5d9b57d68049', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568defa4-2cf7-49ba-b390-7e366cd06451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume volume-4d303875-c97c-4b41-b722-5d9b57d68049 (4d303875-c97c-4b41-b722-5d9b57d68049): created successfully Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568defa4-2cf7-49ba-b390-7e366cd06451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (fce189b5-35bc-42b0-ad7a-f46f128e4b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-54e80c7f-3831-4252-a98f-be46a82ffce1 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created volume successfully. Jul 03 13:04:49 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 1073741824" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:49 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 Jul 03 13:04:49 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:49 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174864482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c158825c-30ec-44fb-9ab9-b65619243aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:47Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Creating volume c158825c-30ec-44fb-9ab9-b65619243aae {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:49 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:50 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae 1073741824 Jul 03 13:04:50 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee168e40-2318-4e7c-b04e-afa7496d8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977306e1-8119-4070-89d6-e89e182a9cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 (8d870c67-7b5a-4fab-a6d0-ab2016919db8): created successfully Jul 03 13:04:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977306e1-8119-4070-89d6-e89e182a9cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (0be756e2-c2bc-4235-8471-067de9bfd23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7fa77537-4a2a-4faa-92e6-350cbe3d5fdd tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created volume successfully. Jul 03 13:04:50 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae 1073741824" returned: 0 in 0.999s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:51 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae Jul 03 13:04:51 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:51 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.307s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497629204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b38d38-7e3d-4124-9faf-03ede9908f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:47Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Creating volume 75b38d38-7e3d-4124-9faf-03ede9908f39 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:51 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:51 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 1073741824 Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb9cf80-aa98-4f14-bf45-a75c1cd2305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c158825c-30ec-44fb-9ab9-b65619243aae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:51 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334edc36-7a61-40ef-8aed-4bd89dade62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume volume-c158825c-30ec-44fb-9ab9-b65619243aae (c158825c-30ec-44fb-9ab9-b65619243aae): created successfully Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334edc36-7a61-40ef-8aed-4bd89dade62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (9b7c298f-6eb6-45e2-8a8e-8c0f309d0328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7aa3f240-f0f3-4863-9230-d050e4ef3295 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created volume successfully. Jul 03 13:04:52 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 1073741824" returned: 0 in 0.995s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:52 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 Jul 03 13:04:52 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:53 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39" returned: 0 in 0.724s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.658s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404503792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756eeb0f-a4a4-4bc5-8328-0b8a7974697d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33829fce1a240ecac0827ef6f506192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:48Z,use_quota=True,user_id='af5e3672ed334165ad2fae5f204d939b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Creating volume 756eeb0f-a4a4-4bc5-8328-0b8a7974697d {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:04:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:53 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d 1073741824 Jul 03 13:04:53 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6450d5c2-4ab5-4622-81b3-5ffdceddace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b38d38-7e3d-4124-9faf-03ede9908f39', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d08c5dc-7028-4c68-b12e-30bbff4c4ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume volume-75b38d38-7e3d-4124-9faf-03ede9908f39 (75b38d38-7e3d-4124-9faf-03ede9908f39): created successfully Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d08c5dc-7028-4c68-b12e-30bbff4c4ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (21f89619-164d-497d-802d-d368c6ef27af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-52f1b4a2-439f-449d-94ad-9d8ad4fd19a2 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created volume successfully. Jul 03 13:04:54 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d 1073741824" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:54 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d Jul 03 13:04:54 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:55 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d" returned: 0 in 0.722s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d942d4d-93a6-4786-96fb-e44f7447a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427c8c0c-f2fd-432b-b61a-17cdb074fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:04:55 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Volume volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d (756eeb0f-a4a4-4bc5-8328-0b8a7974697d): created successfully Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427c8c0c-f2fd-432b-b61a-17cdb074fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Flow 'volume_create_manager' (af240667-aaed-49af-997c-4ae88cfe7c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:04:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-28d979f8-cb94-429d-afe0-c563ac2373ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created volume successfully. Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-756eeb0f-a4a4-4bc5-8328-0b8a7974697d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-756eeb0f-a4a4-4bc5-8328-0b8a7974697d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-quobyte-756eeb0f-a4a4-4bc5-8328-0b8a7974697d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-756eeb0f-a4a4-4bc5-8328-0b8a7974697d" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8f72e-5037-4d93-9285-9fc833586f27]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:55 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d Jul 03 13:04:55 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:56 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d" returned: 0 in 0.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:56 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d Jul 03 13:04:56 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:57 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-756eeb0f-a4a4-4bc5-8328-0b8a7974697d" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-756eeb0f-a4a4-4bc5-8328-0b8a7974697d" released by "delete_volume" :: held 1.632s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created reservations ['3241fbd4-c566-4083-a2b6-7e31589acfda', '8678cfee-d82b-4c59-b1ac-7636b2fe9bf4', '6cd5a72f-d4b7-4606-af6b-6a89219b420f', '355b42f5-7220-48d9-b7d3-8965f9ac1129'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:57 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:57 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-75b38d38-7e3d-4124-9faf-03ede9908f39-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-75b38d38-7e3d-4124-9faf-03ede9908f39-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-quobyte-75b38d38-7e3d-4124-9faf-03ede9908f39" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-75b38d38-7e3d-4124-9faf-03ede9908f39" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[351ccaa4-dfcc-4436-8836-1da015aa7112]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:58 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 Jul 03 13:04:58 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:58 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.807s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:58 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:04:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Deleted volume successfully. Jul 03 13:04:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0f2d522c-373f-41e9-a0a2-1a98bffc723e tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-756eeb0f-a4a4-4bc5-8328-0b8a7974697d-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:58 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:58 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39 Jul 03 13:04:58 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:04:59 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-75b38d38-7e3d-4124-9faf-03ede9908f39" returned: 0 in 0.699s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-75b38d38-7e3d-4124-9faf-03ede9908f39" released by "delete_volume" :: held 1.625s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created reservations ['c4f5c5f4-4373-4f9e-84bf-c8c9fa62fe39', '8e5b5e9b-805b-4d55-b6c0-083e7d1e210d', '4379a0aa-69ac-4b74-9d5c-fdebfc8f665d', 'c2c154a8-34e8-4b73-8a22-a5621a0390a8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:04:59 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:04:59 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-c158825c-30ec-44fb-9ab9-b65619243aae-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-c158825c-30ec-44fb-9ab9-b65619243aae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-quobyte-c158825c-30ec-44fb-9ab9-b65619243aae" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-c158825c-30ec-44fb-9ab9-b65619243aae" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6a3d6-73c6-41dc-8837-a09662ebfcb8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:00 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae Jul 03 13:05:00 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:00 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Deleted volume successfully. Jul 03 13:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-53e25bbf-e991-4c58-8891-4b29e8868852 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-75b38d38-7e3d-4124-9faf-03ede9908f39-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:01 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:01 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae Jul 03 13:05:01 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:02 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:02 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:02 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c158825c-30ec-44fb-9ab9-b65619243aae" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-c158825c-30ec-44fb-9ab9-b65619243aae" released by "delete_volume" :: held 1.870s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created reservations ['6ddd2562-a96f-43e4-b1da-6d9bc3c0a5a1', 'dea73667-73b3-427c-9c4a-e0bde537e376', 'e3587e29-99d3-4ff8-b354-dab0cf6485c9', '1282cad6-b8ee-4ece-9b5f-9f3ae9cd56a4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:02 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:02 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-8d870c67-7b5a-4fab-a6d0-ab2016919db8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-8d870c67-7b5a-4fab-a6d0-ab2016919db8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-quobyte-8d870c67-7b5a-4fab-a6d0-ab2016919db8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-8d870c67-7b5a-4fab-a6d0-ab2016919db8" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abf077c-d165-4ca0-9afa-3754dfa2727c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:02 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 Jul 03 13:05:02 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:02 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:03 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.823s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Deleted volume successfully. Jul 03 13:05:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8eeb4c0f-f642-4943-ac4b-fe9cc0d37a88 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-c158825c-30ec-44fb-9ab9-b65619243aae-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:03 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8" returned: 0 in 1.013s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:03 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8 Jul 03 13:05:03 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:04 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8d870c67-7b5a-4fab-a6d0-ab2016919db8" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-8d870c67-7b5a-4fab-a6d0-ab2016919db8" released by "delete_volume" :: held 1.829s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created reservations ['6fd8747c-4d2d-4c29-a350-06ffeb681aff', '59abb1e0-51ee-4530-816f-ca9bf46d6a68', '0cb40243-6d3e-4671-88f4-b2e29b71050d', '92c27d82-9ad5-4ede-a5cd-9671a0f06fc1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:04 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:04 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-4d303875-c97c-4b41-b722-5d9b57d68049-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-4d303875-c97c-4b41-b722-5d9b57d68049-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-quobyte-4d303875-c97c-4b41-b722-5d9b57d68049" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-4d303875-c97c-4b41-b722-5d9b57d68049" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[53932f05-6d2f-46e8-87eb-5cdd0299c95c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:04 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 Jul 03 13:05:04 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:05 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Deleted volume successfully. Jul 03 13:05:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1507f54f-76c1-4edd-85b0-b135612fd2ee tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-8d870c67-7b5a-4fab-a6d0-ab2016919db8-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:05 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:05 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049 Jul 03 13:05:05 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:06 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4d303875-c97c-4b41-b722-5d9b57d68049" returned: 0 in 0.665s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-4d303875-c97c-4b41-b722-5d9b57d68049" released by "delete_volume" :: held 1.542s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created reservations ['b58d8d4f-6de4-40c8-8c4e-075ab9fdbdad', 'f1740652-e6c0-4098-b617-e568e401e50b', '32a4f84b-9a1a-4f2d-b907-477c75a302e6', '55e741aa-1de3-4536-b0e6-dfa82886c9a5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:06 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:06 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-ce126194-cb95-4fc0-8b7f-777df24b8523-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-ce126194-cb95-4fc0-8b7f-777df24b8523-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "cinder-quobyte-ce126194-cb95-4fc0-8b7f-777df24b8523" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-ce126194-cb95-4fc0-8b7f-777df24b8523" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd5258-a4ea-4c5d-8d52-d503904c33f2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:07 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 Jul 03 13:05:07 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:07 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Deleted volume successfully. Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3b0f770-6390-4569-a16b-1c5a75d5d588 tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-4d303875-c97c-4b41-b722-5d9b57d68049-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:07 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523" returned: 0 in 0.844s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:07 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523 Jul 03 13:05:07 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:08 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ce126194-cb95-4fc0-8b7f-777df24b8523" returned: 0 in 0.700s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-quobyte-ce126194-cb95-4fc0-8b7f-777df24b8523" released by "delete_volume" :: held 1.591s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=87,cinder:INSERT=38,cinder:UPDATE=117,cinder:DELETE=11 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Created reservations ['10244ea1-acb4-4203-b53c-b98ba43d237c', '7459978d-228a-4303-8567-2def0f77a1b2', 'a94c89bb-3519-484b-9baf-7f81ab8ba38e', '9d3ded14-9b23-40be-85e4-fe8d91e7f1e6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:INSERT=30,cinder:SELECT=83,cinder:UPDATE=131,cinder:DELETE=12 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:08 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:08 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:09 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.853s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Deleted volume successfully. Jul 03 13:05:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-01452fd8-559d-4cde-b819-5cbf4d3c451b tempest-CreateVolumesFromSourceVolumeTest-1982817209 None] Lock "cinder-ce126194-cb95-4fc0-8b7f-777df24b8523-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Flow 'volume_create_manager' (1473b5ad-7f75-4caa-8ca6-48499e6a0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b6f66d-6c89-40ae-a4ef-997b5bdb70f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b6f66d-6c89-40ae-a4ef-997b5bdb70f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e14efa6-2d01-48b0-83b8-a101af5555e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2262720c6e4e328467c4e4abcfb83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:12Z,use_quota=True,user_id='2c2465ffa44b4817849973d2a1ea974a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38964e08-1391-4acd-bb41-98368a234c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38964e08-1391-4acd-bb41-98368a234c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3701e31a-f90f-4354-9984-31c57610ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3701e31a-f90f-4354-9984-31c57610ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e14efa6-2d01-48b0-83b8-a101af5555e5', 'volume_name': 'volume-0e14efa6-2d01-48b0-83b8-a101af5555e5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ac50d7-bd2f-4bff-87ab-b25fb19e5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ac50d7-bd2f-4bff-87ab-b25fb19e5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cbfcf4-5f94-4a8c-bde0-921cef2a6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Volume 0e14efa6-2d01-48b0-83b8-a101af5555e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e14efa6-2d01-48b0-83b8-a101af5555e5', 'volume_size': 1} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e14efa6-2d01-48b0-83b8-a101af5555e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2262720c6e4e328467c4e4abcfb83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:12Z,use_quota=True,user_id='2c2465ffa44b4817849973d2a1ea974a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Creating volume 0e14efa6-2d01-48b0-83b8-a101af5555e5 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:05:12 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:12 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 1073741824 Jul 03 13:05:12 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:13 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 1073741824" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:13 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 Jul 03 13:05:13 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:14 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5" returned: 0 in 0.677s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cbfcf4-5f94-4a8c-bde0-921cef2a6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e14efa6-2d01-48b0-83b8-a101af5555e5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6b91ed-7ff6-4593-86c0-cf955da528fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Volume volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 (0e14efa6-2d01-48b0-83b8-a101af5555e5): created successfully Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6b91ed-7ff6-4593-86c0-cf955da528fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Flow 'volume_create_manager' (1473b5ad-7f75-4caa-8ca6-48499e6a0e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2848434b-e953-41a8-bdf8-8ed1b5665c11 tempest-CinderUnicodeTest-825329973 None] Created volume successfully. Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Flow 'volume_create_manager' (11503655-2f25-4866-ac3e-afcc5f9374be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a526e03-6d35-4b00-85d5-3c0fed784d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a526e03-6d35-4b00-85d5-3c0fed784d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-376369569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222e73bb-1f15-4015-94e3-ae0dd3a73e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2262720c6e4e328467c4e4abcfb83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:15Z,use_quota=True,user_id='2c2465ffa44b4817849973d2a1ea974a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947e3d74-1bb7-4d67-a890-b93ae05d404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947e3d74-1bb7-4d67-a890-b93ae05d404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64541710-68c7-4ee9-9df4-8d616fdcfa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64541710-68c7-4ee9-9df4-8d616fdcfa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222e73bb-1f15-4015-94e3-ae0dd3a73e86', 'volume_name': 'volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ae6654-df9c-4c57-be3e-f4b33fe5ce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ae6654-df9c-4c57-be3e-f4b33fe5ce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80f513a-c268-4742-aab7-e570971949f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Volume 222e73bb-1f15-4015-94e3-ae0dd3a73e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86', 'volume_size': 1} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-376369569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222e73bb-1f15-4015-94e3-ae0dd3a73e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2262720c6e4e328467c4e4abcfb83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:15Z,use_quota=True,user_id='2c2465ffa44b4817849973d2a1ea974a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Creating volume 222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:05:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:15 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 1073741824 Jul 03 13:05:15 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:16 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 1073741824" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:16 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 Jul 03 13:05:16 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:16 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86" returned: 0 in 0.691s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80f513a-c268-4742-aab7-e570971949f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e24622-b74e-4585-810e-0fb01e6351c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Volume volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 (222e73bb-1f15-4015-94e3-ae0dd3a73e86): created successfully Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e24622-b74e-4585-810e-0fb01e6351c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Flow 'volume_create_manager' (11503655-2f25-4866-ac3e-afcc5f9374be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7c740571-081d-46a9-9845-4040d9d9cd4f tempest-CinderUnicodeTest-825329973 None] Created volume successfully. Jul 03 13:05:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Creating offline snapshot 9f869478-0cf7-45ea-bdc8-ee0825feb869 of volume 222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:05:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b416995b-849c-4804-ad64-4a5192efe41e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:17 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 Jul 03 13:05:17 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:18 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86" returned: 0 in 0.835s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:18 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 1G Jul 03 13:05:18 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:19 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 1G" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:19 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 Jul 03 13:05:19 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:19 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:19 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 is being set with open permissions: ugo+rw Jul 03 13:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:20 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 Jul 03 13:05:20 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:20 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869" returned: 0 in 0.752s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:20 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info Jul 03 13:05:20 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:21 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info" returned: 0 in 0.688s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:21 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info is being set with open permissions: ugo+rw Jul 03 13:05:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:21 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info Jul 03 13:05:21 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:22 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.info" returned: 0 in 0.738s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.799s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3d22fbc9-a8bd-4286-8ee3-b652afb4e0ee tempest-CinderUnicodeTest-825329973 None] Create snapshot completed successfully Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-9f869478-0cf7-45ea-bdc8-ee0825feb869-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-9f869478-0cf7-45ea-bdc8-ee0825feb869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-quobyte-222e73bb-1f15-4015-94e3-ae0dd3a73e86" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-222e73bb-1f15-4015-94e3-ae0dd3a73e86" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-quobyte-9f869478-0cf7-45ea-bdc8-ee0825feb869" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-9f869478-0cf7-45ea-bdc8-ee0825feb869" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Deleting offline snapshot 9f869478-0cf7-45ea-bdc8-ee0825feb869 of volume 222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] snapshot_file for this snap is: volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2ae55-bd7d-4b82-8a8d-aabda62ee776]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:22 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 Jul 03 13:05:22 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:23 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:05:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ae105-151a-44f4-ad2c-8de6658b85f8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:23 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 Jul 03 13:05:23 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:24 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:24 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 Jul 03 13:05:24 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:25 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:25 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869 Jul 03 13:05:25 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:26 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86.9f869478-0cf7-45ea-bdc8-ee0825feb869" returned: 0 in 0.743s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-9f869478-0cf7-45ea-bdc8-ee0825feb869" released by "_delete_snapshot" :: held 3.319s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-222e73bb-1f15-4015-94e3-ae0dd3a73e86" released by "delete_snapshot" :: held 3.344s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Created reservations ['b0d003aa-7c2a-4529-9f74-9f9eebe468fc', '5410820d-77c1-4d50-8a9e-8717c184f3ec', '5c760eab-3447-40b8-9689-bba7e737b28d', 'a15c14f7-ec93-4047-a75d-4bc6f6bbc573'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Delete snapshot completed successfully. Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a78ddc7e-7954-42be-ad32-797e52997db9 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-9f869478-0cf7-45ea-bdc8-ee0825feb869-delete_snapshot" released by "delete_snapshot" :: held 3.518s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-222e73bb-1f15-4015-94e3-ae0dd3a73e86-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-222e73bb-1f15-4015-94e3-ae0dd3a73e86-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-quobyte-222e73bb-1f15-4015-94e3-ae0dd3a73e86" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-222e73bb-1f15-4015-94e3-ae0dd3a73e86" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[20017b07-9121-4768-bb66-09a5e1673c04]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:27 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 Jul 03 13:05:27 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:27 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86" returned: 0 in 0.807s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:27 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86 Jul 03 13:05:27 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:28 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222e73bb-1f15-4015-94e3-ae0dd3a73e86" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-222e73bb-1f15-4015-94e3-ae0dd3a73e86" released by "delete_volume" :: held 1.580s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Created reservations ['4044f2cb-4542-4495-975e-934443b78d9d', 'e2b009df-eb5b-40cf-9ebb-79e6233018cb', 'c1a8471a-adc1-4d20-b343-230741f22df5', 'a7375400-3a91-4d29-8a13-c851a75f7c2a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:28 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:28 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-0e14efa6-2d01-48b0-83b8-a101af5555e5-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-0e14efa6-2d01-48b0-83b8-a101af5555e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "cinder-quobyte-0e14efa6-2d01-48b0-83b8-a101af5555e5" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-0e14efa6-2d01-48b0-83b8-a101af5555e5" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c9f68-bd52-4b2b-a6b8-8aa09717088b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:29 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.745s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Deleted volume successfully. Jul 03 13:05:29 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 Jul 03 13:05:29 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ece50f15-d87b-4640-9002-09e0b4e8e4a2 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-222e73bb-1f15-4015-94e3-ae0dd3a73e86-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:30 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:30 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5 Jul 03 13:05:30 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:30 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-0e14efa6-2d01-48b0-83b8-a101af5555e5" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-quobyte-0e14efa6-2d01-48b0-83b8-a101af5555e5" released by "delete_volume" :: held 1.621s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Created reservations ['705368ea-0175-4c61-b729-4c3e502de7a0', '791ac551-4c14-4cc7-871c-eeb973a7e445', 'c892370d-5d04-4f0c-9b3b-3264d67126a4', '0a8e3ae9-b9e8-48f0-a5bc-6ff27dc60194'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:31 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:31 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:31 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Deleted volume successfully. Jul 03 13:05:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-170dce7d-7257-4d53-8f7a-61df1faeb396 tempest-CinderUnicodeTest-825329973 None] Lock "cinder-0e14efa6-2d01-48b0-83b8-a101af5555e5-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (fbdaef82-3ab2-4071-a2cd-dcc1e3106832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6a4e14-10ac-4ba5-a726-2ab5141f13e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6a4e14-10ac-4ba5-a726-2ab5141f13e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005643030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555bb7f0-9843-4446-aff9-e607310df4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:36Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9883704-5e92-4a63-b5ed-5f3d452b5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9883704-5e92-4a63-b5ed-5f3d452b5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e76b7df-9a51-4af5-9ce3-7ee2ba6744d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e76b7df-9a51-4af5-9ce3-7ee2ba6744d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555bb7f0-9843-4446-aff9-e607310df4d5', 'volume_name': 'volume-555bb7f0-9843-4446-aff9-e607310df4d5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ad64aa-68fb-4918-b029-453358d30ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ad64aa-68fb-4918-b029-453358d30ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe04cc0-f4b9-4bab-bdca-446579208041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Volume 555bb7f0-9843-4446-aff9-e607310df4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555bb7f0-9843-4446-aff9-e607310df4d5', 'volume_size': 1} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005643030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555bb7f0-9843-4446-aff9-e607310df4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:36Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Creating volume 555bb7f0-9843-4446-aff9-e607310df4d5 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:05:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:36 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 1073741824 Jul 03 13:05:36 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:36 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 1073741824" returned: 0 in 0.897s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:36 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 Jul 03 13:05:36 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:37 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe04cc0-f4b9-4bab-bdca-446579208041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555bb7f0-9843-4446-aff9-e607310df4d5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91fe4aab-c1ca-4f63-af62-6bf2594b0ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Volume volume-555bb7f0-9843-4446-aff9-e607310df4d5 (555bb7f0-9843-4446-aff9-e607310df4d5): created successfully Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91fe4aab-c1ca-4f63-af62-6bf2594b0ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (fbdaef82-3ab2-4071-a2cd-dcc1e3106832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-26d372a8-408a-43ae-bb0a-1b9958a25eb1 tempest-ProjectReaderTests-1530980947 None] Created volume successfully. Jul 03 13:05:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-555bb7f0-9843-4446-aff9-e607310df4d5-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-555bb7f0-9843-4446-aff9-e607310df4d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-quobyte-555bb7f0-9843-4446-aff9-e607310df4d5" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-555bb7f0-9843-4446-aff9-e607310df4d5" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab6464-26b7-4399-a6a8-dd6dcd233074]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:38 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 Jul 03 13:05:38 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:39 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5" returned: 0 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:39 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5 Jul 03 13:05:39 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:39 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-555bb7f0-9843-4446-aff9-e607310df4d5" returned: 0 in 0.685s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-555bb7f0-9843-4446-aff9-e607310df4d5" released by "delete_volume" :: held 1.509s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Created reservations ['e833d94c-084d-4604-aa67-927cd49be1f1', '169e7cfa-5ec3-4ba4-8fdb-de0f51eabd06', '52fcd82a-5afe-402f-abf6-fcb6a6b1cb09', 'b2dbfb75-2a42-43ae-b1a6-5faecdb86c02'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:39 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:39 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:40 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.713s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Deleted volume successfully. Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-025aa73e-a7e5-4668-bf9e-b8801e5b9a75 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-555bb7f0-9843-4446-aff9-e607310df4d5-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (af9d7ee3-4571-4244-9c7b-277fd51fedce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcce029-6929-4c28-8e38-0c23eee93054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcce029-6929-4c28-8e38-0c23eee93054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186602329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bfa12c-63aa-4941-b9b6-8a45cfacee94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:41Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebe73af-34db-40a3-a41e-fe0da8ea8c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebe73af-34db-40a3-a41e-fe0da8ea8c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad7a566-7d33-4f71-abaa-4795170101ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad7a566-7d33-4f71-abaa-4795170101ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bfa12c-63aa-4941-b9b6-8a45cfacee94', 'volume_name': 'volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754e38ae-be71-4510-95c9-051885074138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754e38ae-be71-4510-95c9-051885074138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe241bd-05fb-4708-9b05-5330dc16ec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Volume 10bfa12c-63aa-4941-b9b6-8a45cfacee94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94', 'volume_size': 1} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186602329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bfa12c-63aa-4941-b9b6-8a45cfacee94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:41Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Creating volume 10bfa12c-63aa-4941-b9b6-8a45cfacee94 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:05:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:41 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 1073741824 Jul 03 13:05:41 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:41 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 1073741824" returned: 0 in 0.943s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:42 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 Jul 03 13:05:42 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:42 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94" returned: 0 in 0.703s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe241bd-05fb-4708-9b05-5330dc16ec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160de9a8-b08a-4ba7-91a6-489c8f397339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Volume volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 (10bfa12c-63aa-4941-b9b6-8a45cfacee94): created successfully Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160de9a8-b08a-4ba7-91a6-489c8f397339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (af9d7ee3-4571-4244-9c7b-277fd51fedce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ff51bac-7ad2-4e6f-a777-d2e02e423100 tempest-ProjectReaderTests-1530980947 None] Created volume successfully. Jul 03 13:05:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-10bfa12c-63aa-4941-b9b6-8a45cfacee94-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Lock "cinder-10bfa12c-63aa-4941-b9b6-8a45cfacee94-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-quobyte-10bfa12c-63aa-4941-b9b6-8a45cfacee94" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-10bfa12c-63aa-4941-b9b6-8a45cfacee94" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e116e0-048c-4f0c-8d83-ee26049a7705]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:43 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 Jul 03 13:05:43 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:44 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94" returned: 0 in 0.853s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:44 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94 Jul 03 13:05:44 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:44 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-10bfa12c-63aa-4941-b9b6-8a45cfacee94" returned: 0 in 0.737s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-10bfa12c-63aa-4941-b9b6-8a45cfacee94" released by "delete_volume" :: held 1.631s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Created reservations ['7e770815-48e0-4eca-a4cc-a8a837d85e93', 'e0d8845c-2744-41ea-8565-ef08ca13226b', '4a9848cd-bf7b-49ec-9e18-0e5623e1fedc', '7fddb4b8-92bb-417b-90a6-6769ba9c7887'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:44 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:44 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:45 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Deleted volume successfully. Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a502c9fb-0dc8-4d6e-953f-f341512e7d1e tempest-ProjectReaderTests-1530980947 None] Lock "cinder-10bfa12c-63aa-4941-b9b6-8a45cfacee94-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (79e7af3b-c2b4-4882-9639-9e31a9d09c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f93a43-95e0-496b-8665-4bc617ca0389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f93a43-95e0-496b-8665-4bc617ca0389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-359716509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1258a177-c4d7-468a-9a97-aebdb1cf02b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:46Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03592ea-9ee3-4e95-9e43-76397e23b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03592ea-9ee3-4e95-9e43-76397e23b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc558097-95f6-493e-aadd-bad6369d85e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc558097-95f6-493e-aadd-bad6369d85e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1258a177-c4d7-468a-9a97-aebdb1cf02b9', 'volume_name': 'volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2c85ac-b6d2-4a3e-858c-08cad00bd549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2c85ac-b6d2-4a3e-858c-08cad00bd549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08891077-c696-418d-8b70-d07873681ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Volume 1258a177-c4d7-468a-9a97-aebdb1cf02b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9', 'volume_size': 1} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-359716509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1258a177-c4d7-468a-9a97-aebdb1cf02b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:46Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Creating volume 1258a177-c4d7-468a-9a97-aebdb1cf02b9 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:05:45 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:45 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 1073741824 Jul 03 13:05:45 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:46 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 1073741824" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:46 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 Jul 03 13:05:46 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:47 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08891077-c696-418d-8b70-d07873681ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc46c2b-eff2-46a4-a31a-5c4e3a3d58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Volume volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 (1258a177-c4d7-468a-9a97-aebdb1cf02b9): created successfully Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc46c2b-eff2-46a4-a31a-5c4e3a3d58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (79e7af3b-c2b4-4882-9639-9e31a9d09c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fd073f46-3ea9-4809-a907-cb95549fe434 tempest-ProjectReaderTests-1530980947 None] Created volume successfully. Jul 03 13:05:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-1258a177-c4d7-468a-9a97-aebdb1cf02b9-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-1258a177-c4d7-468a-9a97-aebdb1cf02b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-quobyte-1258a177-c4d7-468a-9a97-aebdb1cf02b9" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-1258a177-c4d7-468a-9a97-aebdb1cf02b9" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:48 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac62e6-854c-4ef4-b2b5-6adb71400149]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:48 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 Jul 03 13:05:48 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:49 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:49 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9 Jul 03 13:05:49 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:49 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1258a177-c4d7-468a-9a97-aebdb1cf02b9" returned: 0 in 0.737s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-1258a177-c4d7-468a-9a97-aebdb1cf02b9" released by "delete_volume" :: held 1.653s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Created reservations ['57282eac-4823-442e-9784-caf70b1ff792', '8deea81d-36d0-4504-b56d-5c44802ffd41', '2ab20545-ec0e-4a5d-9070-6fd41f639efe', '008bc4f9-d67f-4099-b4de-6618950d47c8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:49 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:49 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:50 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Deleted volume successfully. Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-12486b2d-63eb-4041-b289-36cfc90f23f9 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-1258a177-c4d7-468a-9a97-aebdb1cf02b9-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (b6911845-28b1-4a38-b8cb-9c3f3ffa5ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a879f2-5ca6-4d60-ae35-791da0de9b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a879f2-5ca6-4d60-ae35-791da0de9b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924754970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e34aa4-d26a-4ef9-b857-a436b309c595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:51Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d273ba-3efc-4d45-bad5-4552e9ab9235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d273ba-3efc-4d45-bad5-4552e9ab9235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ac1d3b-0c9e-493e-8a3a-d37329bf4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ac1d3b-0c9e-493e-8a3a-d37329bf4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e34aa4-d26a-4ef9-b857-a436b309c595', 'volume_name': 'volume-12e34aa4-d26a-4ef9-b857-a436b309c595', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b938d68b-1cb3-4d71-ae09-eef53bbb51f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b938d68b-1cb3-4d71-ae09-eef53bbb51f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a4110d-cf6b-4f37-a26b-5ae2d9277fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Volume 12e34aa4-d26a-4ef9-b857-a436b309c595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e34aa4-d26a-4ef9-b857-a436b309c595', 'volume_size': 1} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924754970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e34aa4-d26a-4ef9-b857-a436b309c595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc5606328b44438a0039c905e92290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:51Z,use_quota=True,user_id='d428ce57a5e7425e9864ccd592b017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Creating volume 12e34aa4-d26a-4ef9-b857-a436b309c595 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:05:51 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:51 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 1073741824 Jul 03 13:05:51 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:51 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 1073741824" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:52 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 Jul 03 13:05:52 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:52 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595" returned: 0 in 0.694s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a4110d-cf6b-4f37-a26b-5ae2d9277fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e34aa4-d26a-4ef9-b857-a436b309c595', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4dcbf-2bb7-47a7-bd4b-c9768edd1632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:05:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Volume volume-12e34aa4-d26a-4ef9-b857-a436b309c595 (12e34aa4-d26a-4ef9-b857-a436b309c595): created successfully Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4dcbf-2bb7-47a7-bd4b-c9768edd1632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:05:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Flow 'volume_create_manager' (b6911845-28b1-4a38-b8cb-9c3f3ffa5ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:05:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7f26298a-f254-42b5-a58b-65a195f8dd47 tempest-ProjectReaderTests-1530980947 None] Created volume successfully. Jul 03 13:05:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-12e34aa4-d26a-4ef9-b857-a436b309c595-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-12e34aa4-d26a-4ef9-b857-a436b309c595-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "cinder-quobyte-12e34aa4-d26a-4ef9-b857-a436b309c595" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:05:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-12e34aa4-d26a-4ef9-b857-a436b309c595" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:05:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0c0649-6acc-478a-984b-45ee1ee9d77a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:05:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:53 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 Jul 03 13:05:53 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:54 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595" returned: 0 in 0.882s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:54 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595 Jul 03 13:05:54 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:54 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-12e34aa4-d26a-4ef9-b857-a436b309c595" returned: 0 in 0.722s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-quobyte-12e34aa4-d26a-4ef9-b857-a436b309c595" released by "delete_volume" :: held 1.648s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Created reservations ['db9033ee-6621-477c-8398-9a567b08dbd9', '2077fda6-cac4-4c7d-b511-2b73b7bf7fd0', 'c8d3a4ab-6d35-4111-9ff0-70a103015fb9', '6876f010-015e-40b0-9ddc-8b650c679e19'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:05:54 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:05:54 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:05:55 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 03 13:05:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:05:55 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:05:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Deleted volume successfully. Jul 03 13:05:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-770a8189-0b4a-45f9-af2a-6207bd7b86f2 tempest-ProjectReaderTests-1530980947 None] Lock "cinder-12e34aa4-d26a-4ef9-b857-a436b309c595-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:02 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:02 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:02 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.779s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:04 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=86,cinder:SELECT=57,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:06:05 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=74,cinder:SELECT=49,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (f244d90c-3647-46f5-8937-2f4bfffb9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e2a757-7876-4f8c-a1f5-b830eae5b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e2a757-7876-4f8c-a1f5-b830eae5b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602378475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abace5e-a398-43b5-90ed-afab2212e5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:09Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cef4db6-cb35-44af-a9e1-550e00dbf82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cef4db6-cb35-44af-a9e1-550e00dbf82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c432e59f-4602-4e3f-bc84-735d139d3ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c432e59f-4602-4e3f-bc84-735d139d3ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abace5e-a398-43b5-90ed-afab2212e5fd', 'volume_name': 'volume-7abace5e-a398-43b5-90ed-afab2212e5fd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7f6fd9-8f09-46f3-9168-fc6de7a53085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7f6fd9-8f09-46f3-9168-fc6de7a53085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7018a12-b7ca-4551-9375-e02a5bb3f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume 7abace5e-a398-43b5-90ed-afab2212e5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abace5e-a398-43b5-90ed-afab2212e5fd', 'volume_size': 1} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602378475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abace5e-a398-43b5-90ed-afab2212e5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:09Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Creating volume 7abace5e-a398-43b5-90ed-afab2212e5fd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:08 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:08 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd 1073741824 Jul 03 13:06:08 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (5ba02a99-bb0a-40b9-93bc-4a2153907d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1754afd-874c-4780-9d82-a01f9397ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1754afd-874c-4780-9d82-a01f9397ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002099621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:09Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f57e05c-d708-4540-bef2-a1f5f03bd090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f57e05c-d708-4540-bef2-a1f5f03bd090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ffb953-31e3-4034-9164-be78ec31b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ffb953-31e3-4034-9164-be78ec31b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b', 'volume_name': 'volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3874d0d-72ab-446b-a5ee-7c5307f191b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3874d0d-72ab-446b-a5ee-7c5307f191b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6fbe0e-a76b-4818-8685-b1db61e41cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Volume 107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b', 'volume_size': 1} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Flow 'volume_create_manager' (c0699c22-b9e2-4268-8c5f-0ad527270cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec546494-d3be-4fcc-9e6b-2a6dc1fa945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec546494-d3be-4fcc-9e6b-2a6dc1fa945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-889551239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbf994b-40bf-4f49-be75-909dcee7c195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b71c7dba148e299e362d1bcf6e266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='1be76aa1f00842679a995b52a7a3a18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9b84b3-c458-4827-9089-5d94530ae770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9b84b3-c458-4827-9089-5d94530ae770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd8c172-664f-4f24-84e4-a4dbcce08c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd8c172-664f-4f24-84e4-a4dbcce08c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbf994b-40bf-4f49-be75-909dcee7c195', 'volume_name': 'volume-9bbf994b-40bf-4f49-be75-909dcee7c195', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83897d52-be86-4cf3-823e-19070bfc9497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83897d52-be86-4cf3-823e-19070bfc9497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612801f1-a0c9-414b-a2e3-368c19981530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Volume 9bbf994b-40bf-4f49-be75-909dcee7c195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbf994b-40bf-4f49-be75-909dcee7c195', 'volume_size': 1} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (8ac94e15-17b7-4f1f-84c5-106b0810c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24aa2ab2-0bef-454b-9fb8-a356e7fd19ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24aa2ab2-0bef-454b-9fb8-a356e7fd19ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014919216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f1a7d3-8074-45a6-9858-4c146e058b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1e6f48-2c2f-4629-b9f1-41bad9ea8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1e6f48-2c2f-4629-b9f1-41bad9ea8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5829400b-227b-4a7a-874a-69f5ff7df5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5829400b-227b-4a7a-874a-69f5ff7df5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f1a7d3-8074-45a6-9858-4c146e058b7a', 'volume_name': 'volume-76f1a7d3-8074-45a6-9858-4c146e058b7a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07437b8-0a7a-4689-8d63-459bca9ac6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07437b8-0a7a-4689-8d63-459bca9ac6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcaf90d-d4c0-485b-94ef-267687a882ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Volume 76f1a7d3-8074-45a6-9858-4c146e058b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f1a7d3-8074-45a6-9858-4c146e058b7a', 'volume_size': 1} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:10 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (5e11f880-f20c-4224-8299-d478f9304d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27611117-bc65-475d-985e-33bc860b357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd 1073741824" returned: 0 in 1.466s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27611117-bc65-475d-985e-33bc860b357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923625128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b8cdd0-1228-41af-a569-a4e5f43ad9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6488ea6-724c-4ec6-9658-d4d4bd5fa330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6488ea6-724c-4ec6-9658-d4d4bd5fa330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1642e246-a412-453e-bed3-e25666b136fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1642e246-a412-453e-bed3-e25666b136fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b8cdd0-1228-41af-a569-a4e5f43ad9e9', 'volume_name': 'volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d5219-b58a-4980-95e3-489fe1b41d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d5219-b58a-4980-95e3-489fe1b41d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90a802b-a3c3-4218-b135-7a1c6800c603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Volume 54b8cdd0-1228-41af-a569-a4e5f43ad9e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9', 'volume_size': 1} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:10 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd Jul 03 13:06:10 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (b9ad2a8f-abd9-48a0-b32e-94aea3271eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e529a5-c303-4964-af94-4c3a971e9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e529a5-c303-4964-af94-4c3a971e9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-559211145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5f629e-ac1e-45b2-8949-414ce8081e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:11Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2c3710-9428-4c45-8486-549a9fef50fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2c3710-9428-4c45-8486-549a9fef50fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6268b5e9-dc38-4afa-87e3-071bc6706f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6268b5e9-dc38-4afa-87e3-071bc6706f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5f629e-ac1e-45b2-8949-414ce8081e27', 'volume_name': 'volume-ca5f629e-ac1e-45b2-8949-414ce8081e27', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1be126-59c5-4b5f-9ea7-5b48e914eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1be126-59c5-4b5f-9ea7-5b48e914eea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6580d15-e032-48cf-9757-cec07099e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Volume ca5f629e-ac1e-45b2-8949-414ce8081e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5f629e-ac1e-45b2-8949-414ce8081e27', 'volume_size': 1} Jul 03 13:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (387dc94d-5ce4-4bc4-86e5-bee1bbb3ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff37f82-4c04-4058-8b35-954a12f948b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff37f82-4c04-4058-8b35-954a12f948b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547156010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56db8134-7b60-44fa-8e5e-1419792df717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:11Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abbbb51-48bd-41fa-b304-0a834ef9fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:11 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abbbb51-48bd-41fa-b304-0a834ef9fdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fa79a9-2a8b-451b-9b95-c4e38df20573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fa79a9-2a8b-451b-9b95-c4e38df20573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56db8134-7b60-44fa-8e5e-1419792df717', 'volume_name': 'volume-56db8134-7b60-44fa-8e5e-1419792df717', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7368eca5-4c3d-415f-a1bc-3987e2f91062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7368eca5-4c3d-415f-a1bc-3987e2f91062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee64873-778d-406b-a765-7b6b0052699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Volume 56db8134-7b60-44fa-8e5e-1419792df717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56db8134-7b60-44fa-8e5e-1419792df717', 'volume_size': 1} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd" returned: 0 in 0.999s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] <== create_volume: return (2583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.593s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.091s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002099621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:09Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Creating volume 107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7018a12-b7ca-4551-9375-e02a5bb3f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abace5e-a398-43b5-90ed-afab2212e5fd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:11 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b 1073741824 Jul 03 13:06:11 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd975082-9b1e-41b1-99e8-66b1012be98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume volume-7abace5e-a398-43b5-90ed-afab2212e5fd (7abace5e-a398-43b5-90ed-afab2212e5fd): created successfully Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd975082-9b1e-41b1-99e8-66b1012be98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (f244d90c-3647-46f5-8937-2f4bfffb9d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-47971697-5715-46d2-b77c-7abeb049cd5e tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created volume successfully. Jul 03 13:06:12 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b 1073741824" returned: 0 in 1.215s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:12 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b Jul 03 13:06:12 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:12 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (5e1e23e1-20db-4bb4-ae64-cb571674f297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029d2f91-c708-4bbc-972e-b76259cb9055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029d2f91-c708-4bbc-972e-b76259cb9055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-38236550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3347d5-c90e-40e1-9116-a0bd1315fa2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:13Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6572924a-7755-415a-9979-a1a0dca5b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6572924a-7755-415a-9979-a1a0dca5b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c17340-d667-420f-a797-2196e6f398f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c17340-d667-420f-a797-2196e6f398f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3347d5-c90e-40e1-9116-a0bd1315fa2f', 'volume_name': 'volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed43df1-ca48-4064-aaa9-cb48e87cfd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed43df1-ca48-4064-aaa9-cb48e87cfd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232bdfaf-759d-40e2-8a88-83910f61e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume 4e3347d5-c90e-40e1-9116-a0bd1315fa2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f', 'volume_size': 1} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (cdfdf5a2-8350-4137-9433-9f78f6970309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93489ad4-2b5c-4e70-98f8-910450425675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93489ad4-2b5c-4e70-98f8-910450425675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412258777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05d9c6b-e4ff-4010-a80a-27ab345d5f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:13Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44f553a-1fdc-42cc-a065-cbe971164611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44f553a-1fdc-42cc-a065-cbe971164611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6895074-4050-400d-9a49-3a055e4ba45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6895074-4050-400d-9a49-3a055e4ba45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05d9c6b-e4ff-4010-a80a-27ab345d5f45', 'volume_name': 'volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9841847f-b973-4038-b8d1-abd49cec50ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9841847f-b973-4038-b8d1-abd49cec50ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9edf08-e91f-403f-ab71-716fe5723ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume c05d9c6b-e4ff-4010-a80a-27ab345d5f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45', 'volume_size': 1} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:13 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b" returned: 0 in 1.206s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] <== create_volume: return (2479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.483s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-889551239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbf994b-40bf-4f49-be75-909dcee7c195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b71c7dba148e299e362d1bcf6e266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='1be76aa1f00842679a995b52a7a3a18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Creating volume 9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:13 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:13 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 1073741824 Jul 03 13:06:13 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6fbe0e-a76b-4818-8685-b1db61e41cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b269b65a-d1f0-4443-a5a7-2301b14309db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Volume volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b (107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b): created successfully Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b269b65a-d1f0-4443-a5a7-2301b14309db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (5ba02a99-bb0a-40b9-93bc-4a2153907d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8ec4d542-649b-441b-92e3-c539f96b4e3c tempest-CreateVolumesFromImageTest-1124330039 None] Created volume successfully. Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (8120af59-078a-48d4-a8ce-374548b505df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83c6bdc-edfe-4b20-8b6b-8080f0be09b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83c6bdc-edfe-4b20-8b6b-8080f0be09b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453595966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd21f0e-0a11-4308-9e48-c0a7c1f445b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:14Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5ca4ee-b53d-4661-810d-914c9852deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5ca4ee-b53d-4661-810d-914c9852deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe904c8-6c00-4a06-8016-f99c9af1ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe904c8-6c00-4a06-8016-f99c9af1ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd21f0e-0a11-4308-9e48-c0a7c1f445b0', 'volume_name': 'volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2884f95a-6273-415a-b206-021b9f2ace3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2884f95a-6273-415a-b206-021b9f2ace3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc166f8-d057-4a35-915e-f161fcaa041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume fdd21f0e-0a11-4308-9e48-c0a7c1f445b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0', 'volume_size': 1} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (4e1105da-c42c-499d-a8de-44224409b95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ca58ef-1b7f-4baa-bb85-eba5c2073672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ca58ef-1b7f-4baa-bb85-eba5c2073672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196173369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192f188f-bd8f-403f-b3d7-85c2e6251ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:15Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cedf4fa-c809-4cc2-a6ce-1b7df07f8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cedf4fa-c809-4cc2-a6ce-1b7df07f8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02133c09-4323-4b1c-a9d6-26227e250d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02133c09-4323-4b1c-a9d6-26227e250d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192f188f-bd8f-403f-b3d7-85c2e6251ddf', 'volume_name': 'volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b9ec5-0787-4424-9e2f-247206052ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b9ec5-0787-4424-9e2f-247206052ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea645b9-a925-45cc-87c0-c45934fcc66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume 192f188f-bd8f-403f-b3d7-85c2e6251ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf', 'volume_size': 1} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Flow 'volume_create_manager' (1ee0356d-ad52-4147-a151-1145fe3fda18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:15 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66620f3b-d9a5-4841-9020-900abe687e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 1073741824" returned: 0 in 1.286s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66620f3b-d9a5-4841-9020-900abe687e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544a533e-c41d-45e3-897c-e8619d17256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682aafbb591472580eafddc638626ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:15Z,use_quota=True,user_id='bbc0a3f31aef42d19d6ece5bb549739b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc66c336-c335-4759-b8df-515d70f00cb9),volume_type_id=fc66c336-c335-4759-b8df-515d70f00cb9)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42a0713-b43b-4f52-bfb3-213e9e98c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42a0713-b43b-4f52-bfb3-213e9e98c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220e7fe0-f25e-4e69-aff8-b2b168db0dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (d9c24b9e-23dc-458a-a295-cbefc7bcd7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf2782b-6024-437b-8875-0aa9c62b9dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf2782b-6024-437b-8875-0aa9c62b9dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155676708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8608dbee-5306-4160-8e2f-f18dc6fb4ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:15Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8749458f-b24b-4651-b81d-8a340d3e6d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8749458f-b24b-4651-b81d-8a340d3e6d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7aef6e6-e191-4a4e-aa9a-af35c4c0fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7aef6e6-e191-4a4e-aa9a-af35c4c0fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8608dbee-5306-4160-8e2f-f18dc6fb4ca8', 'volume_name': 'volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07820494-ed41-475f-95ee-a3a47a71b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07820494-ed41-475f-95ee-a3a47a71b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77218a11-36f6-4c25-9525-3958ec76abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume 8608dbee-5306-4160-8e2f-f18dc6fb4ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8', 'volume_size': 1} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:15 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:06:15 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220e7fe0-f25e-4e69-aff8-b2b168db0dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '544a533e-c41d-45e3-897c-e8619d17256e', 'volume_name': 'volume-544a533e-c41d-45e3-897c-e8619d17256e', 'volume_size': 1, 'image_id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f163278-6cea-4fda-ba64-b05f9eabd032', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6eb3446bc598e8f49e85b7f4e07abf5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7682aafbb591472580eafddc638626ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a0158edbc51c9e6c8b0228ca3df1d5c9f9e43585ca391c48f7ff77c4dbb1817ac6da012e46faf9cd95b88c970a72f7be88d792594e74ffaab59ed5f042f8ad45', 'id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'created_at': datetime.datetime(2026, 7, 3, 11, 6, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f163278-6cea-4fda-ba64-b05f9eabd032/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb75cbbc-9aab-47a1-b712-5b8c70876404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb75cbbc-9aab-47a1-b712-5b8c70876404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3509f0-fdcf-46a4-9c23-ac4327932fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Volume 544a533e-c41d-45e3-897c-e8619d17256e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-544a533e-c41d-45e3-897c-e8619d17256e', 'volume_size': 1, 'image_id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f163278-6cea-4fda-ba64-b05f9eabd032', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6eb3446bc598e8f49e85b7f4e07abf5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7682aafbb591472580eafddc638626ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a0158edbc51c9e6c8b0228ca3df1d5c9f9e43585ca391c48f7ff77c4dbb1817ac6da012e46faf9cd95b88c970a72f7be88d792594e74ffaab59ed5f042f8ad45', 'id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'created_at': datetime.datetime(2026, 7, 3, 11, 6, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f163278-6cea-4fda-ba64-b05f9eabd032/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Trying to clone 544a533e-c41d-45e3-897c-e8619d17256e from image 1f163278-6cea-4fda-ba64-b05f9eabd032 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f163278-6cea-4fda-ba64-b05f9eabd032', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:06:15 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Image download 0.00 MB at 0.00 MB/s Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c2a613-19a7-4270-a404-4b3992896760]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:15 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD Jul 03 13:06:15 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:16 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014919216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f1a7d3-8074-45a6-9858-4c146e058b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Creating volume 76f1a7d3-8074-45a6-9858-4c146e058b7a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612801f1-a0c9-414b-a2e3-368c19981530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbf994b-40bf-4f49-be75-909dcee7c195', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:16 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a 1073741824 Jul 03 13:06:16 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332aa0f5-4075-4def-8748-feaf321280f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Volume volume-9bbf994b-40bf-4f49-be75-909dcee7c195 (9bbf994b-40bf-4f49-be75-909dcee7c195): created successfully Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332aa0f5-4075-4def-8748-feaf321280f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Flow 'volume_create_manager' (c0699c22-b9e2-4268-8c5f-0ad527270cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-feb1b685-dcd1-4808-afaa-f557fb995748 tempest-VolumeDependencyTests-2078351485 None] Created volume successfully. Jul 03 13:06:16 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:16 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD Jul 03 13:06:16 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:17 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a 1073741824" returned: 0 in 1.198s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:17 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a Jul 03 13:06:17 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:17 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD" returned: 1 in 1.070s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Temporary image 1f163278-6cea-4fda-ba64-b05f9eabd032 is fetched for user bbc0a3f31aef42d19d6ece5bb549739b. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[34267961-0539-4e92-bb1d-b69e8d13d2bd]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:17 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD Jul 03 13:06:17 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:18 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.960s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923625128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b8cdd0-1228-41af-a569-a4e5f43ad9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Creating volume 54b8cdd0-1228-41af-a569-a4e5f43ad9e9 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:18 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 1073741824 Jul 03 13:06:18 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcaf90d-d4c0-485b-94ef-267687a882ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f1a7d3-8074-45a6-9858-4c146e058b7a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8db8bb-403b-4856-888f-e77a6a5060d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Volume volume-76f1a7d3-8074-45a6-9858-4c146e058b7a (76f1a7d3-8074-45a6-9858-4c146e058b7a): created successfully Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8db8bb-403b-4856-888f-e77a6a5060d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (8ac94e15-17b7-4f1f-84c5-106b0810c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0ceae952-e980-4337-8586-8ec6a2927a96 tempest-CreateVolumesFromImageTest-1124330039 None] Created volume successfully. Jul 03 13:06:18 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:18 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD Jul 03 13:06:18 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:19 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 1073741824" returned: 0 in 1.078s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:19 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 Jul 03 13:06:19 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:19 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD" returned: 1 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:06:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:20 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9" returned: 0 in 0.731s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.354s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-559211145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5f629e-ac1e-45b2-8949-414ce8081e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:11Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Creating volume ca5f629e-ac1e-45b2-8949-414ce8081e27 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:20 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:20 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 1073741824 Jul 03 13:06:20 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90a802b-a3c3-4218-b135-7a1c6800c603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695d9f14-e4ac-4f13-89fc-06e2981dc5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Volume volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 (54b8cdd0-1228-41af-a569-a4e5f43ad9e9): created successfully Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695d9f14-e4ac-4f13-89fc-06e2981dc5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (5e11f880-f20c-4224-8299-d478f9304d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e3986f24-9401-432d-9492-9bb9185a6d3e tempest-CreateVolumesFromImageTest-1124330039 None] Created volume successfully. Jul 03 13:06:21 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 1073741824" returned: 0 in 1.159s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:21 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 Jul 03 13:06:21 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:22 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27" returned: 0 in 0.853s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.923s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547156010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56db8134-7b60-44fa-8e5e-1419792df717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd313f7c29854564adc8963a398424b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:11Z,use_quota=True,user_id='ff49309f89d04631871a7485d35ede84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Creating volume 56db8134-7b60-44fa-8e5e-1419792df717 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:22 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:22 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 1073741824 Jul 03 13:06:22 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6580d15-e032-48cf-9757-cec07099e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5f629e-ac1e-45b2-8949-414ce8081e27', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dba450-2ebf-42ce-8d24-7d623c3b2af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:22 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Volume volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 (ca5f629e-ac1e-45b2-8949-414ce8081e27): created successfully Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dba450-2ebf-42ce-8d24-7d623c3b2af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (b9ad2a8f-abd9-48a0-b32e-94aea3271eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bad5bf38-53da-457c-b4dd-59a553941912 tempest-CreateVolumesFromImageTest-1124330039 None] Created volume successfully. Jul 03 13:06:23 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 1073741824" returned: 0 in 0.979s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:23 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 Jul 03 13:06:23 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:23 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717" returned: 0 in 0.718s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.896s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-38236550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3347d5-c90e-40e1-9116-a0bd1315fa2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:13Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Creating volume 4e3347d5-c90e-40e1-9116-a0bd1315fa2f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:24 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee64873-778d-406b-a765-7b6b0052699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56db8134-7b60-44fa-8e5e-1419792df717', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:24 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f 1073741824 Jul 03 13:06:24 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36595aa9-97ff-4a16-a561-4c436695327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Volume volume-56db8134-7b60-44fa-8e5e-1419792df717 (56db8134-7b60-44fa-8e5e-1419792df717): created successfully Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36595aa9-97ff-4a16-a561-4c436695327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Flow 'volume_create_manager' (387dc94d-5ce4-4bc4-86e5-bee1bbb3ec99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6a09f0ab-4eba-4349-8adb-4ed35a02e71b tempest-CreateVolumesFromImageTest-1124330039 None] Created volume successfully. Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-56db8134-7b60-44fa-8e5e-1419792df717-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-56db8134-7b60-44fa-8e5e-1419792df717-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-quobyte-56db8134-7b60-44fa-8e5e-1419792df717" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-56db8134-7b60-44fa-8e5e-1419792df717" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3442d64b-dd71-4586-9b79-ef25014f3093]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:24 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 Jul 03 13:06:24 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:24 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f 1073741824" returned: 0 in 0.988s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:25 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f Jul 03 13:06:25 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:25 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:25 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717 Jul 03 13:06:25 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:25 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.377s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412258777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05d9c6b-e4ff-4010-a80a-27ab345d5f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:13Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Creating volume c05d9c6b-e4ff-4010-a80a-27ab345d5f45 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:25 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:25 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 1073741824 Jul 03 13:06:25 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232bdfaf-759d-40e2-8a88-83910f61e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab4bf61-ca16-4630-bc2e-7b8d73ca3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f (4e3347d5-c90e-40e1-9116-a0bd1315fa2f): created successfully Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab4bf61-ca16-4630-bc2e-7b8d73ca3064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (5e1e23e1-20db-4bb4-ae64-cb571674f297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9906eb53-2395-445d-8500-869d1ee65f2a tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created volume successfully. Jul 03 13:06:26 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-56db8134-7b60-44fa-8e5e-1419792df717" returned: 0 in 0.745s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-56db8134-7b60-44fa-8e5e-1419792df717" released by "delete_volume" :: held 1.690s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Created reservations ['8fcf157f-da10-4d7f-8987-cbf8aaf5e9ad', '321122ae-0036-439b-aab4-912610582f78', 'c358321e-2ca8-4ec9-acc6-1487f692e38e', '216fe848-d053-466b-93bd-1b19622a3adb'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:26 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:26 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-ca5f629e-ac1e-45b2-8949-414ce8081e27-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-ca5f629e-ac1e-45b2-8949-414ce8081e27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-quobyte-ca5f629e-ac1e-45b2-8949-414ce8081e27" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-ca5f629e-ac1e-45b2-8949-414ce8081e27" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:26 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 1073741824" returned: 0 in 1.107s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a314b-08ca-418f-a057-aeb74d9d9be4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:27 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 Jul 03 13:06:27 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:27 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 Jul 03 13:06:27 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:27 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Deleted volume successfully. Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2f0f5aab-a979-430d-9763-a69c293ba731 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-56db8134-7b60-44fa-8e5e-1419792df717-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:27 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:27 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.764s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453595966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd21f0e-0a11-4308-9e48-c0a7c1f445b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:14Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Creating volume fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27" returned: 0 in 0.937s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:27 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 1073741824 Jul 03 13:06:27 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9edf08-e91f-403f-ab71-716fe5723ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188bc122-c7b5-4bea-841e-8eb9dde9bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:27 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27 Jul 03 13:06:27 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 (c05d9c6b-e4ff-4010-a80a-27ab345d5f45): created successfully Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188bc122-c7b5-4bea-841e-8eb9dde9bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (cdfdf5a2-8350-4137-9433-9f78f6970309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5070e571-1367-41ba-949a-e5fea35141e6 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created volume successfully. Jul 03 13:06:28 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-ca5f629e-ac1e-45b2-8949-414ce8081e27" returned: 0 in 0.738s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-ca5f629e-ac1e-45b2-8949-414ce8081e27" released by "delete_volume" :: held 1.727s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Created reservations ['ff06183d-4767-43b5-b6bf-05c0944a0192', 'b6fd5fe5-dc9a-4ec4-8935-7891e01ac5db', 'd322d4b1-2875-4106-ac19-87235c39f60e', 'e5b5a5b5-c91e-456c-9b7a-55025b4dcadd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:28 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 1073741824" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:28 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:28 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:28 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 Jul 03 13:06:28 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-54b8cdd0-1228-41af-a569-a4e5f43ad9e9-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-54b8cdd0-1228-41af-a569-a4e5f43ad9e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-quobyte-54b8cdd0-1228-41af-a569-a4e5f43ad9e9" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-54b8cdd0-1228-41af-a569-a4e5f43ad9e9" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ade048-aa20-437b-a168-2c0453584033]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:29 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 Jul 03 13:06:29 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:29 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Deleted volume successfully. Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c8ec34f-eb7c-436d-9074-ab1f229b4326 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-ca5f629e-ac1e-45b2-8949-414ce8081e27-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:29 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.690s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196173369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192f188f-bd8f-403f-b3d7-85c2e6251ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:15Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Creating volume 192f188f-bd8f-403f-b3d7-85c2e6251ddf {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc166f8-d057-4a35-915e-f161fcaa041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857dc815-bb13-4fbc-9a9f-7e7d86b393f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:29 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf 1073741824 Jul 03 13:06:29 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 (fdd21f0e-0a11-4308-9e48-c0a7c1f445b0): created successfully Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857dc815-bb13-4fbc-9a9f-7e7d86b393f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (8120af59-078a-48d4-a8ce-374548b505df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-50763ef0-3fa8-482d-a31b-1bda503db3bb tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created volume successfully. Jul 03 13:06:30 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:30 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9 Jul 03 13:06:30 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:30 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf 1073741824" returned: 0 in 0.959s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:30 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf Jul 03 13:06:30 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:31 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-54b8cdd0-1228-41af-a569-a4e5f43ad9e9" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-54b8cdd0-1228-41af-a569-a4e5f43ad9e9" released by "delete_volume" :: held 1.784s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Created reservations ['b000905e-f7be-4aea-bc54-7c9692597138', '9714baa9-2fd8-4c10-8cb8-1d280ff64bb8', '98be8d80-0320-45ea-813d-a27715ba9f0b', '9d3f71b7-c042-4c64-bd09-1b2f77467e35'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:31 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:31 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-76f1a7d3-8074-45a6-9858-4c146e058b7a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-76f1a7d3-8074-45a6-9858-4c146e058b7a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-quobyte-76f1a7d3-8074-45a6-9858-4c146e058b7a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:31 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf" returned: 0 in 0.808s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-76f1a7d3-8074-45a6-9858-4c146e058b7a" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.344s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155676708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8608dbee-5306-4160-8e2f-f18dc6fb4ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fa4ed618fb45e79899990dd8e621f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:15Z,use_quota=True,user_id='ce6b6ebf079d4cfba26c80aeab606aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Creating volume 8608dbee-5306-4160-8e2f-f18dc6fb4ca8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:31 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea8f5a-881c-4c05-813e-81ae7dc67abe]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:31 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 1073741824 Jul 03 13:06:31 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea645b9-a925-45cc-87c0-c45934fcc66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed1ae33-1de9-4fa3-b8e1-de6bc58d1dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf (192f188f-bd8f-403f-b3d7-85c2e6251ddf): created successfully Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed1ae33-1de9-4fa3-b8e1-de6bc58d1dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (4e1105da-c42c-499d-a8de-44224409b95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-232c50d6-2244-446b-88ff-52eb76cd52cc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created volume successfully. Jul 03 13:06:31 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a Jul 03 13:06:31 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:32 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Deleted volume successfully. Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-106c793f-2451-42c1-929b-7d410fbbedea tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-54b8cdd0-1228-41af-a569-a4e5f43ad9e9-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:32 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:32 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a Jul 03 13:06:32 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:32 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 1073741824" returned: 0 in 1.095s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:32 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 Jul 03 13:06:32 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:33 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-76f1a7d3-8074-45a6-9858-4c146e058b7a" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-76f1a7d3-8074-45a6-9858-4c146e058b7a" released by "delete_volume" :: held 1.753s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Created reservations ['65a511c4-e963-4327-94c9-be7b161160f0', 'd6d88afe-7f09-4532-a1ff-0bb7d9e7cbcf', '6301fcf2-62b4-415a-8125-14933b5b55e0', '418adb36-96fc-42f4-930c-b8e4b7a2e35b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:33 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:33 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:33 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8" returned: 0 in 0.817s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.216s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Creating offline snapshot 0a2c6d34-29f8-46d6-9f2e-111b89d05871 of volume 9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77218a11-36f6-4c25-9525-3958ec76abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4cf85c-95e8-4ff3-b245-d1d88362e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fa2085-d462-47ff-ab76-dd9e26d76d9c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Volume volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 (8608dbee-5306-4160-8e2f-f18dc6fb4ca8): created successfully Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4cf85c-95e8-4ff3-b245-d1d88362e7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Flow 'volume_create_manager' (d9c24b9e-23dc-458a-a295-cbefc7bcd7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3579b0c0-26a2-461a-a473-cf6eb6a51d1c tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created volume successfully. Jul 03 13:06:33 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:06:33 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "cinder-quobyte-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2854ab33-0e34-4da9-a2a0-bb0db847e9b1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:34 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b Jul 03 13:06:34 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:34 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.832s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Deleted volume successfully. Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c74aa5f8-6880-48df-b166-e55af9d1eefa tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-76f1a7d3-8074-45a6-9858-4c146e058b7a-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-8608dbee-5306-4160-8e2f-f18dc6fb4ca8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-8608dbee-5306-4160-8e2f-f18dc6fb4ca8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:34 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:34 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 1G Jul 03 13:06:34 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-quobyte-8608dbee-5306-4160-8e2f-f18dc6fb4ca8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-8608dbee-5306-4160-8e2f-f18dc6fb4ca8" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f9dd3-e598-4cc5-aab5-1e3728014942]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:34 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 Jul 03 13:06:34 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:34 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b" returned: 0 in 0.948s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:34 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b Jul 03 13:06:34 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:35 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 1G" returned: 0 in 1.012s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbf994b-40bf-4f49-be75-909dcee7c195 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:35 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbf994b-40bf-4f49-be75-909dcee7c195 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 Jul 03 13:06:35 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:35 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8" returned: 0 in 0.950s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:35 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:35 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8 Jul 03 13:06:35 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b" returned: 0 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-quobyte-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b" released by "delete_volume" :: held 1.807s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Created reservations ['2a181549-b86f-4b13-8044-a060bc316710', 'd7233c06-269a-431c-8279-aa18e077a868', 'de0427cc-b4d7-4f43-a028-825d0066dbbf', 'ad73196f-7da8-40b3-8fbd-61ec80292b1c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:35 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:35 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:36 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-8608dbee-5306-4160-8e2f-f18dc6fb4ca8" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-8608dbee-5306-4160-8e2f-f18dc6fb4ca8" released by "delete_volume" :: held 1.780s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:36 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbf994b-40bf-4f49-be75-909dcee7c195 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:36 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 is being set with open permissions: ugo+rw Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:36 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 Jul 03 13:06:36 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created reservations ['e90784d3-396b-4c23-9c17-84d0a9ea66db', 'ff59c6a2-f832-4ada-8a39-5fc19d293225', '9c3e86fc-b5ba-4ef4-9929-b1bddfc192af', '68dc8bd1-786d-4351-a485-b3a65140c56a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:36 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Deleted volume successfully. Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-833bd601-80a3-4ad6-92d3-483299433806 tempest-CreateVolumesFromImageTest-1124330039 None] Lock "cinder-107bcf7b-a3a1-47ce-bc2b-4a72c1bffe0b-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:36 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:36 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-192f188f-bd8f-403f-b3d7-85c2e6251ddf-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-192f188f-bd8f-403f-b3d7-85c2e6251ddf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-quobyte-192f188f-bd8f-403f-b3d7-85c2e6251ddf" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-192f188f-bd8f-403f-b3d7-85c2e6251ddf" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d535e-4601-4a48-85f0-9179dea4e1d7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:37 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf Jul 03 13:06:37 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:37 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871" returned: 0 in 1.021s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:37 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info Jul 03 13:06:37 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:37 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.979s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Deleted volume successfully. Jul 03 13:06:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b60a9252-b9e5-4086-8c5d-150ba3af0ed1 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-8608dbee-5306-4160-8e2f-f18dc6fb4ca8-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:38 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:38 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf Jul 03 13:06:38 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:38 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:38 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info is being set with open permissions: ugo+rw Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:38 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info Jul 03 13:06:38 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:38 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-192f188f-bd8f-403f-b3d7-85c2e6251ddf" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-192f188f-bd8f-403f-b3d7-85c2e6251ddf" released by "delete_volume" :: held 1.849s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created reservations ['ced27eab-f47f-44f1-9901-6023bed79035', 'b660bfc7-818e-4fef-aa53-40c85f222d86', 'b614f9b7-4041-4dd1-a299-a4ce5bafa053', 'b04916cc-023f-4c44-a934-157a1b810bd1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:39 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:39 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:39 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.info" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.659s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.630s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544a533e-c41d-45e3-897c-e8619d17256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682aafbb591472580eafddc638626ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:15Z,use_quota=True,user_id='bbc0a3f31aef42d19d6ece5bb549739b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc66c336-c335-4759-b8df-515d70f00cb9),volume_type_id=fc66c336-c335-4759-b8df-515d70f00cb9)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Creating volume 544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:39 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e 1073741824 Jul 03 13:06:39 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2b17e3bc-0a07-4538-92bf-efda1645962f tempest-VolumeDependencyTests-2078351485 None] Create snapshot completed successfully Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-quobyte-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[11905db5-e53c-44ff-9e52-f959130fec3c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:39 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 Jul 03 13:06:39 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:39 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Deleted volume successfully. Jul 03 13:06:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b153aca1-3ad1-43fc-95e0-f1bf62c6eb31 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-192f188f-bd8f-403f-b3d7-85c2e6251ddf-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (0ec32488-b2a3-4d41-baa2-8756e7a7d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42689844-9fdb-4179-bd57-7e1218d879d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42689844-9fdb-4179-bd57-7e1218d879d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992141965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f2ba8-99da-4374-8c56-171cad5dc002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:40Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6468f627-7dc4-42bb-b05a-2b23aec87f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6468f627-7dc4-42bb-b05a-2b23aec87f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f655fcc-da55-462a-9be4-cfd2dfd51e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f655fcc-da55-462a-9be4-cfd2dfd51e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491f2ba8-99da-4374-8c56-171cad5dc002', 'volume_name': 'volume-491f2ba8-99da-4374-8c56-171cad5dc002', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4722f4-4bea-4e88-888d-aa9a560632d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4722f4-4bea-4e88-888d-aa9a560632d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce46267-e7b1-4972-95ad-a9e61f4b45a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume 491f2ba8-99da-4374-8c56-171cad5dc002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491f2ba8-99da-4374-8c56-171cad5dc002', 'volume_size': 1} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:40 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e 1073741824" returned: 0 in 1.355s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:40 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0" returned: 0 in 1.171s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:40 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0 Jul 03 13:06:40 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:40 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:40 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Flow 'volume_create_manager' (ac67a063-4e66-4a98-83a0-e5471430e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9081516d-58ed-4b05-88b6-5c67f41fda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9081516d-58ed-4b05-88b6-5c67f41fda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-371881943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7833ad-630b-469c-aa7a-35a12aa31c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b71c7dba148e299e362d1bcf6e266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a2c6d34-29f8-46d6-9f2e-111b89d05871,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:41Z,use_quota=True,user_id='1be76aa1f00842679a995b52a7a3a18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bf9401-c2f7-4c9a-b6e9-39403febd79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bf9401-c2f7-4c9a-b6e9-39403febd79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1cbae4-572a-4465-9c8b-fc3ff67ce882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1cbae4-572a-4465-9c8b-fc3ff67ce882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd7833ad-630b-469c-aa7a-35a12aa31c89', 'volume_name': 'volume-dd7833ad-630b-469c-aa7a-35a12aa31c89', 'volume_size': 1, 'snapshot_id': '0a2c6d34-29f8-46d6-9f2e-111b89d05871'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9202151d-ebfa-4489-8d02-9551448ef9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9202151d-ebfa-4489-8d02-9551448ef9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a111bc8-edf4-4aa5-a434-3083862251df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Volume dd7833ad-630b-469c-aa7a-35a12aa31c89: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd7833ad-630b-469c-aa7a-35a12aa31c89', 'volume_size': 1, 'snapshot_id': '0a2c6d34-29f8-46d6-9f2e-111b89d05871'} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:41 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0" released by "delete_volume" :: held 2.025s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:41 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992141965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f2ba8-99da-4374-8c56-171cad5dc002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:40Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating volume 491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:41 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 1073741824 Jul 03 13:06:41 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Attempting download of 1f163278-6cea-4fda-ba64-b05f9eabd032 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f163278-6cea-4fda-ba64-b05f9eabd032', 'metadata': {}}])) to volume 544a533e-c41d-45e3-897c-e8619d17256e. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created reservations ['e0347270-fb38-4513-9f5d-86eaf68260ed', '88009c20-d73d-48bd-8610-a7261eaa5ffa', '2b3635a9-1b38-441a-8dc1-84ee8fe21d4f', '79290b1d-0410-428d-b05a-4aa4a3d46911'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[72394a9a-d51c-4be0-b08d-d346b9dce863]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:41 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:41 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:41 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb Jul 03 13:06:41 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:42 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.863s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Deleted volume successfully. Jul 03 13:06:42 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20c2217-dae1-4d43-8d0b-02aaa8efea67 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-fdd21f0e-0a11-4308-9e48-c0a7c1f445b0-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:42 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 1073741824" returned: 0 in 1.171s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-c05d9c6b-e4ff-4010-a80a-27ab345d5f45-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-c05d9c6b-e4ff-4010-a80a-27ab345d5f45-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:42 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb Jul 03 13:06:42 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:42 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 Jul 03 13:06:42 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-quobyte-c05d9c6b-e4ff-4010-a80a-27ab345d5f45" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-c05d9c6b-e4ff-4010-a80a-27ab345d5f45" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c0de8b-399f-4d55-8c0f-8594c53a1bb0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:42 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 Jul 03 13:06:42 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:43 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb" returned: 1 in 0.929s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f163278-6cea-4fda-ba64-b05f9eabd032_0sj3q5qb' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:06:43 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[451dd255-b8c3-4382-b024-36f3c68cafc7]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.387s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-quobyte-0a2c6d34-29f8-46d6-9f2e-111b89d05871-dd7833ad-630b-469c-aa7a-35a12aa31c89" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce46267-e7b1-4972-95ad-a9e61f4b45a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491f2ba8-99da-4374-8c56-171cad5dc002', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84ac368-2be4-4cb4-a74f-d82780bbb608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume volume-491f2ba8-99da-4374-8c56-171cad5dc002 (491f2ba8-99da-4374-8c56-171cad5dc002): created successfully Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84ac368-2be4-4cb4-a74f-d82780bbb608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (0ec32488-b2a3-4d41-baa2-8756e7a7d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-0a2c6d34-29f8-46d6-9f2e-111b89d05871-dd7833ad-630b-469c-aa7a-35a12aa31c89" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Creating volume dd7833ad-630b-469c-aa7a-35a12aa31c89 from snapshot 0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-quobyte-dd7833ad-630b-469c-aa7a-35a12aa31c89" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-43d6f326-8a36-4f9c-8b51-a7d75d24ec27 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created volume successfully. Jul 03 13:06:43 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD Jul 03 13:06:43 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-dd7833ad-630b-469c-aa7a-35a12aa31c89" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] snapshot: 0a2c6d34-29f8-46d6-9f2e-111b89d05871, volume: dd7833ad-630b-469c-aa7a-35a12aa31c89, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:43 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e243304f-56f0-4f0b-94ec-591241e00e1c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:43 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45 Jul 03 13:06:43 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:43 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 Jul 03 13:06:43 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:44 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:44 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD Jul 03 13:06:44 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:44 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-c05d9c6b-e4ff-4010-a80a-27ab345d5f45" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-c05d9c6b-e4ff-4010-a80a-27ab345d5f45" released by "delete_volume" :: held 1.731s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created reservations ['e4345ed8-53e8-4d38-afd1-484fd4f1d9b0', '050b5a33-51e7-42e3-9025-9d6c1090e618', '275e5202-c64c-4599-906c-80dc651acffe', '8854c4ed-a97d-4739-a64b-2c8b7118de8e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:44 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871" returned: 0 in 0.995s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbf994b-40bf-4f49-be75-909dcee7c195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:06:44 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:44 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0d3017-10cb-48c7-b250-bb6a6be4d966]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:44 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:06:44 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-4e3347d5-c90e-40e1-9116-a0bd1315fa2f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-4e3347d5-c90e-40e1-9116-a0bd1315fa2f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-quobyte-4e3347d5-c90e-40e1-9116-a0bd1315fa2f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-4e3347d5-c90e-40e1-9116-a0bd1315fa2f" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb93c5b-6229-48a5-bb84-c66ea9577def]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:45 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD" returned: 1 in 1.037s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] 1f163278-6cea-4fda-ba64-b05f9eabd032 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:45 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f Jul 03 13:06:45 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:45 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:45 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:45 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Deleted volume successfully. Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e8fed98d-1d26-40fc-8fdf-155d64103b74 tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-c05d9c6b-e4ff-4010-a80a-27ab345d5f45-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:45 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 1.037s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:45 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 Jul 03 13:06:45 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:46 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f" returned: 0 in 0.953s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:46 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f Jul 03 13:06:46 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:46 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:46 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f163278-6cea-4fda-ba64-b05f9eabd032_1tlde1xtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:06:46 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 13:06:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:46 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e 1G Jul 03 13:06:46 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:47 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4e3347d5-c90e-40e1-9116-a0bd1315fa2f" returned: 0 in 1.052s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-4e3347d5-c90e-40e1-9116-a0bd1315fa2f" released by "delete_volume" :: held 2.110s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:47 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e 1G" returned: 0 in 1.199s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created reservations ['817f8363-8e00-4170-b099-761896e91696', '9cc71216-ce50-41ff-9ed7-867adfa1a3d5', '9daecdfc-65c1-47cf-b80d-b1556f37e9a3', 'cd16aed3-b41b-49af-9a4a-cb4b65caf146'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10124d1-2740-417f-ad94-c367d7446780]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:47 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:47 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:48 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:48 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-7abace5e-a398-43b5-90ed-afab2212e5fd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-7abace5e-a398-43b5-90ed-afab2212e5fd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "cinder-quobyte-7abace5e-a398-43b5-90ed-afab2212e5fd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-7abace5e-a398-43b5-90ed-afab2212e5fd" acquired by "delete_volume" :: waited 0.052s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec8710-d933-4e24-b085-5f7eda8f24b4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:49 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd Jul 03 13:06:49 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:49 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 0 in 1.866s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:49 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:49 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:50 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 2.026s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Deleted volume successfully. Jul 03 13:06:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f168ce9-8c4b-4a6e-9fc4-77f2f0be46ca tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-4e3347d5-c90e-40e1-9116-a0bd1315fa2f-delete_volume" released by "delete_volume" :: held 4.957s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:51 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd" returned: 0 in 2.388s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:51 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd Jul 03 13:06:51 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:51 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 1 in 2.397s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Downloaded image 1f163278-6cea-4fda-ba64-b05f9eabd032 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f163278-6cea-4fda-ba64-b05f9eabd032', 'metadata': {}}])) to volume 544a533e-c41d-45e3-897c-e8619d17256e successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Temporary image 1f163278-6cea-4fda-ba64-b05f9eabd032 for user bbc0a3f31aef42d19d6ece5bb549739b is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Marking volume 544a533e-c41d-45e3-897c-e8619d17256e as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Copying metadata from image 1f163278-6cea-4fda-ba64-b05f9eabd032 to 544a533e-c41d-45e3-897c-e8619d17256e. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:06:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Creating volume glance metadata for volume 544a533e-c41d-45e3-897c-e8619d17256e backed by image 1f163278-6cea-4fda-ba64-b05f9eabd032 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6eb3446bc598e8f49e85b7f4e07abf5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3509f0-fdcf-46a4-9c23-ac4327932fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544a533e-c41d-45e3-897c-e8619d17256e', 'volume_size': 1, 'image_id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f163278-6cea-4fda-ba64-b05f9eabd032', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6eb3446bc598e8f49e85b7f4e07abf5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7682aafbb591472580eafddc638626ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a0158edbc51c9e6c8b0228ca3df1d5c9f9e43585ca391c48f7ff77c4dbb1817ac6da012e46faf9cd95b88c970a72f7be88d792594e74ffaab59ed5f042f8ad45', 'id': '1f163278-6cea-4fda-ba64-b05f9eabd032', 'created_at': datetime.datetime(2026, 7, 3, 11, 6, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f163278-6cea-4fda-ba64-b05f9eabd032/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935c34cc-31b9-4c75-9b8b-ab5af1cefd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Volume volume-544a533e-c41d-45e3-897c-e8619d17256e (544a533e-c41d-45e3-897c-e8619d17256e): created successfully Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935c34cc-31b9-4c75-9b8b-ab5af1cefd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Flow 'volume_create_manager' (1ee0356d-ad52-4147-a151-1145fe3fda18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c7497b85-38c6-48b5-8998-a9152663da20 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Created volume successfully. Jul 03 13:06:52 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89" returned: 0 in 6.646s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bca96b-8b5f-4c0a-9163-78832ece0b8b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:52 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7abace5e-a398-43b5-90ed-afab2212e5fd" returned: 0 in 1.191s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-quobyte-7abace5e-a398-43b5-90ed-afab2212e5fd" released by "delete_volume" :: held 3.687s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:52 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:06:52 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Created reservations ['4ce0c0fb-341e-42e9-979e-c7254404a11e', 'c99219b5-1200-4157-8c4f-cbd42d731a98', 'de6b6ad3-541c-4460-b934-7a9a43d7676a', '0b980e25-3b20-4eed-a329-3f963187f1ab'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:52 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:52 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Acquiring lock "cinder-544a533e-c41d-45e3-897c-e8619d17256e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "cinder-544a533e-c41d-45e3-897c-e8619d17256e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Acquiring lock "cinder-quobyte-544a533e-c41d-45e3-897c-e8619d17256e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "cinder-quobyte-544a533e-c41d-45e3-897c-e8619d17256e" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb46f4b-57a7-4ca2-b46b-dc4c5ec6c143]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:53 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:53 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:53 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.866s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Deleted volume successfully. Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8871267e-e25b-494d-ba6a-b9c2b59225dc tempest-CreateVolumesFromSourceVolumeTest-2055741134 None] Lock "cinder-7abace5e-a398-43b5-90ed-afab2212e5fd-delete_volume" released by "delete_volume" :: held 4.893s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:53 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 1.208s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:06:53 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Converted 1024.00 MB image at 154.06 MB/s Jul 03 13:06:53 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 is being set with open permissions: ugo+rw Jul 03 13:06:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:53 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 Jul 03 13:06:53 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:54 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:54 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:54 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:54 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-dd7833ad-630b-469c-aa7a-35a12aa31c89" released by "_copy_volume_from_snapshot" :: held 10.897s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-0a2c6d34-29f8-46d6-9f2e-111b89d05871-dd7833ad-630b-469c-aa7a-35a12aa31c89" released by "_create_volume_from_snapshot" :: held 10.957s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.024s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.671s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating offline snapshot 44f61315-ff61-44f6-9502-79f4505f14f4 of volume 491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a111bc8-edf4-4aa5-a434-3083862251df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7833ad-630b-469c-aa7a-35a12aa31c89', 'volume_size': 1, 'snapshot_id': '0a2c6d34-29f8-46d6-9f2e-111b89d05871'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24315a80-a0f8-4730-b91b-11490ace8ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa259b-87f1-4447-bcaf-e1e57569db75]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Volume volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 (dd7833ad-630b-469c-aa7a-35a12aa31c89): created successfully Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24315a80-a0f8-4730-b91b-11490ace8ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Flow 'volume_create_manager' (ac67a063-4e66-4a98-83a0-e5471430e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:06:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aaf2547f-880f-41e2-a0ad-e241c30b1fde tempest-VolumeDependencyTests-2078351485 None] Created volume successfully. Jul 03 13:06:54 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 Jul 03 13:06:54 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:55 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 1 in 1.050s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:55 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e Jul 03 13:06:55 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:55 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002" returned: 0 in 1.017s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-0a2c6d34-29f8-46d6-9f2e-111b89d05871-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:55 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 1G Jul 03 13:06:55 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-0a2c6d34-29f8-46d6-9f2e-111b89d05871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-quobyte-9bbf994b-40bf-4f49-be75-909dcee7c195" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-9bbf994b-40bf-4f49-be75-909dcee7c195" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-quobyte-0a2c6d34-29f8-46d6-9f2e-111b89d05871" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-0a2c6d34-29f8-46d6-9f2e-111b89d05871" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Deleting offline snapshot 0a2c6d34-29f8-46d6-9f2e-111b89d05871 of volume 9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] snapshot_file for this snap is: volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[054727fb-926e-4f18-a734-4e81c1d8945b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:55 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 Jul 03 13:06:55 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:56 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-544a533e-c41d-45e3-897c-e8619d17256e" returned: 0 in 0.860s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "cinder-quobyte-544a533e-c41d-45e3-897c-e8619d17256e" released by "delete_volume" :: held 2.909s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Created reservations ['6b136897-51b2-438d-afe9-1d40ed982b27', 'a21d3fe6-15aa-4cd8-a194-f3e35185b344', '2dbbf665-6f16-4e13-b867-69e84bf1fbec', '7815c123-f3cb-4263-a230-25c62c0deb68'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:56 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:06:56 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:56 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871" returned: 0 in 1.019s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbf994b-40bf-4f49-be75-909dcee7c195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9201fa-33e7-4414-9310-b5034d50eec7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:56 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 1G" returned: 0 in 1.274s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491f2ba8-99da-4374-8c56-171cad5dc002 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:57 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491f2ba8-99da-4374-8c56-171cad5dc002 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 Jul 03 13:06:57 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:57 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:06:57 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:57 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.949s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:06:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Deleted volume successfully. Jul 03 13:06:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ce0d4025-f270-40f3-80aa-d06cffc8df85 tempest-VolumeAndVolumeTypeFromImageTest-1313521943 None] Lock "cinder-544a533e-c41d-45e3-897c-e8619d17256e-delete_volume" released by "delete_volume" :: held 4.197s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:06:58 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 1.223s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:58 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 Jul 03 13:06:58 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:58 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491f2ba8-99da-4374-8c56-171cad5dc002 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4" returned: 0 in 1.250s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:58 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 is being set with open permissions: ugo+rw Jul 03 13:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:58 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 Jul 03 13:06:58 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:59 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:59 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info Jul 03 13:06:59 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:06:59 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 03 13:06:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871" returned: 0 in 1.315s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:06:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:06:59 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871 Jul 03 13:06:59 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:00 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info" returned: 0 in 1.175s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:00 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info is being set with open permissions: ugo+rw Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:00 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info Jul 03 13:07:00 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:00 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195.0a2c6d34-29f8-46d6-9f2e-111b89d05871" returned: 0 in 1.046s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-0a2c6d34-29f8-46d6-9f2e-111b89d05871" released by "_delete_snapshot" :: held 4.762s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-9bbf994b-40bf-4f49-be75-909dcee7c195" released by "delete_snapshot" :: held 4.795s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Created reservations ['13772dfe-e473-484f-88e9-8e6b2aa4b8d9', '6921d28f-ea79-4fa2-8735-b2581775d9ef', '5a18aa51-49d9-4578-8028-a3fbda31618e', '7392e057-f405-496e-9b8a-395d62dd6a35'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Delete snapshot completed successfully. Jul 03 13:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-845f5df0-939a-4c0d-abf2-e13bd2fb1b0b tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-0a2c6d34-29f8-46d6-9f2e-111b89d05871-delete_snapshot" released by "delete_snapshot" :: held 5.052s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-9bbf994b-40bf-4f49-be75-909dcee7c195-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-9bbf994b-40bf-4f49-be75-909dcee7c195-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-quobyte-9bbf994b-40bf-4f49-be75-909dcee7c195" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-9bbf994b-40bf-4f49-be75-909dcee7c195" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:01 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.info" returned: 0 in 1.018s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.878s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b020e-aaea-429e-b064-f66dfdd8336c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d6e9cb5f-8f1a-4e12-bb5f-4b5eadfedb60 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Create snapshot completed successfully Jul 03 13:07:01 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:07:01 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:02 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:02 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:03 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 1.576s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:03 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195 Jul 03 13:07:03 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (9597e32f-350d-4115-a514-412eb6e02b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c02389a-8048-4116-93e6-65fb499c5be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:03 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c02389a-8048-4116-93e6-65fb499c5be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1266261503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d6dea4-ee36-4a33-8ae0-fe95f5297293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:03Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88976ae-5898-4cd4-a336-1fd3c4d4ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88976ae-5898-4cd4-a336-1fd3c4d4ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a1b487-8852-4bee-b96e-38ce03770b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a1b487-8852-4bee-b96e-38ce03770b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d6dea4-ee36-4a33-8ae0-fe95f5297293', 'volume_name': 'volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1aeaa4-2743-4dc1-b01a-d25419394fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1aeaa4-2743-4dc1-b01a-d25419394fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41759cd0-1349-4017-a04a-ee4b04d68667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:03 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume 47d6dea4-ee36-4a33-8ae0-fe95f5297293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293', 'volume_size': 1} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1266261503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d6dea4-ee36-4a33-8ae0-fe95f5297293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:03Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating volume 47d6dea4-ee36-4a33-8ae0-fe95f5297293 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:03 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.277s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:03 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 1073741824 Jul 03 13:07:03 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (e6590e28-b669-4c11-8829-fa3bc3d55f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cae87c-fa77-4947-b00f-ba3cc2cb1e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cae87c-fa77-4947-b00f-ba3cc2cb1e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215913731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91de9739-ad41-4a6f-b283-78eb880d3f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:04Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d4cf68-4e16-42c2-94ed-f5950ca65675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d4cf68-4e16-42c2-94ed-f5950ca65675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c6cf32-80ff-4024-bc9a-507976022172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c6cf32-80ff-4024-bc9a-507976022172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91de9739-ad41-4a6f-b283-78eb880d3f05', 'volume_name': 'volume-91de9739-ad41-4a6f-b283-78eb880d3f05', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d232a0-c174-483d-ba13-c2c5884447a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d232a0-c174-483d-ba13-c2c5884447a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315cd048-f01c-4dcd-90cc-be0a28f8a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume 91de9739-ad41-4a6f-b283-78eb880d3f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91de9739-ad41-4a6f-b283-78eb880d3f05', 'volume_size': 1} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:04 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9bbf994b-40bf-4f49-be75-909dcee7c195" returned: 0 in 1.268s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-9bbf994b-40bf-4f49-be75-909dcee7c195" released by "delete_volume" :: held 2.987s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Created reservations ['f6e7b98c-61f0-46ad-a418-a1eb006f80bd', 'a4773439-6fc5-4ebe-b7dc-475f375a785d', 'c8963e16-3740-4658-81fc-dd3935c6e06b', '5e56e687-bf81-45cb-9e4c-9bf0353007d6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:04 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:04 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (334e606d-642f-4715-aae2-2e6be1ca825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a11ac31-627d-4626-9b36-3bc21de66419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a11ac31-627d-4626-9b36-3bc21de66419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1520959193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9a75ef-3dfe-4e1c-a90b-309b4b37a756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:05Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d933c53a-6103-4265-af02-a5451571df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d933c53a-6103-4265-af02-a5451571df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdc6df7-c973-4003-b3d8-da4d3af60b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdc6df7-c973-4003-b3d8-da4d3af60b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9a75ef-3dfe-4e1c-a90b-309b4b37a756', 'volume_name': 'volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111a45b3-c28d-48b9-9573-321a23469466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111a45b3-c28d-48b9-9573-321a23469466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d39dd1a-178c-491f-b2e5-ba75136f9066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume 4b9a75ef-3dfe-4e1c-a90b-309b4b37a756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756', 'volume_size': 1} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-dd7833ad-630b-469c-aa7a-35a12aa31c89-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-dd7833ad-630b-469c-aa7a-35a12aa31c89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=117,cinder:UPDATE=168,cinder:DELETE=14,cinder:INSERT=41 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "cinder-quobyte-dd7833ad-630b-469c-aa7a-35a12aa31c89" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-dd7833ad-630b-469c-aa7a-35a12aa31c89" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562c519-8fb7-456c-9bc4-fba700ed15bf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:05 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 1073741824" returned: 0 in 1.917s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:05 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 Jul 03 13:07:05 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 Jul 03 13:07:05 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:05 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=120,cinder:UPDATE=153,cinder:INSERT=42,cinder:DELETE=15 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (7b28c381-c237-4f11-a321-815bfbbad6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb3a542-c61c-46e4-962f-ddab15d190d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb3a542-c61c-46e4-962f-ddab15d190d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47186978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebc5018-e4b1-4933-874f-11a30756c137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:06Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe27a827-6325-44f1-a8e6-e78d5ac3fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe27a827-6325-44f1-a8e6-e78d5ac3fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5651ce6b-d5e4-44ed-ab8b-b115f7d6174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5651ce6b-d5e4-44ed-ab8b-b115f7d6174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebc5018-e4b1-4933-874f-11a30756c137', 'volume_name': 'volume-1ebc5018-e4b1-4933-874f-11a30756c137', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcabda3-9102-4ba9-800c-28f586d5e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcabda3-9102-4ba9-800c-28f586d5e553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca46c241-ce8d-4e0c-9100-e1f07c07724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume 1ebc5018-e4b1-4933-874f-11a30756c137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebc5018-e4b1-4933-874f-11a30756c137', 'volume_size': 1} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.475s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Deleted volume successfully. Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b31697b0-a4db-4fa1-8094-e97b641d6110 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-9bbf994b-40bf-4f49-be75-909dcee7c195-delete_volume" released by "delete_volume" :: held 4.836s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:06 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89" returned: 0 in 1.334s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:06 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89 Jul 03 13:07:06 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:06 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (0f974455-ed34-4ef3-a1e9-85e6d9181b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2edeef-e996-4468-8334-2c444456fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293" returned: 0 in 1.350s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] <== create_volume: return (3383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.389s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215913731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91de9739-ad41-4a6f-b283-78eb880d3f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:04Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating volume 91de9739-ad41-4a6f-b283-78eb880d3f05 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:06 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2edeef-e996-4468-8334-2c444456fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334430135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173cfdcf-caa5-44e7-8c34-750535fc2ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:06Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b83514-8231-460c-bf04-540f0427eabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b83514-8231-460c-bf04-540f0427eabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 1073741824 Jul 03 13:07:06 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d20e6c-a27f-4d67-8e70-fc19e07f12d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d20e6c-a27f-4d67-8e70-fc19e07f12d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173cfdcf-caa5-44e7-8c34-750535fc2ffa', 'volume_name': 'volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95db04bf-2965-42b0-9786-2fe5c7e9190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95db04bf-2965-42b0-9786-2fe5c7e9190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57175156-fcd5-4e7f-a7e8-355ddc6f0a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume 173cfdcf-caa5-44e7-8c34-750535fc2ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa', 'volume_size': 1} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41759cd0-1349-4017-a04a-ee4b04d68667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03a4ff7-d2d5-4874-8d7e-2d5c7062385f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 (47d6dea4-ee36-4a33-8ae0-fe95f5297293): created successfully Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03a4ff7-d2d5-4874-8d7e-2d5c7062385f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (9597e32f-350d-4115-a514-412eb6e02b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0af6aad9-e8f5-4c80-9535-f38062ba6dbf tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created volume successfully. Jul 03 13:07:07 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-dd7833ad-630b-469c-aa7a-35a12aa31c89" returned: 0 in 1.170s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-quobyte-dd7833ad-630b-469c-aa7a-35a12aa31c89" released by "delete_volume" :: held 2.584s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Created reservations ['3c3ea349-1ad5-43e4-8006-97953f1938cf', '6fb9088b-0e1c-4709-a9c0-92eef1d27202', '34783957-c4cb-4b30-8d4d-cf0743d0ff17', '5c2b8c97-cb1a-4e79-bc44-ab81d42b4986'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:07 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:07 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:08 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 1073741824" returned: 0 in 1.323s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:08 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 Jul 03 13:07:08 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:08 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.101s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:08 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Deleted volume successfully. Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7a8fc9cb-078f-41db-a889-8441a7cff5d9 tempest-VolumeDependencyTests-2078351485 None] Lock "cinder-dd7833ad-630b-469c-aa7a-35a12aa31c89-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:09 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05" returned: 0 in 1.010s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.151s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1520959193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9a75ef-3dfe-4e1c-a90b-309b4b37a756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:05Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating volume 4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:09 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315cd048-f01c-4dcd-90cc-be0a28f8a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91de9739-ad41-4a6f-b283-78eb880d3f05', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:09 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 1073741824 Jul 03 13:07:09 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e4924b-45ed-4f28-b634-55166292a8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume volume-91de9739-ad41-4a6f-b283-78eb880d3f05 (91de9739-ad41-4a6f-b283-78eb880d3f05): created successfully Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e4924b-45ed-4f28-b634-55166292a8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (e6590e28-b669-4c11-8829-fa3bc3d55f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5f87df43-1e1f-4c86-b985-9d1dfc37cff0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created volume successfully. Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Flow 'volume_create_manager' (c66d86a2-bc41-4156-b869-0d3a49a8528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cef2488-4184-46cc-859e-0664dcddbfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:10 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cef2488-4184-46cc-859e-0664dcddbfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991d8409-81b9-4f32-9514-453bda3d31a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc87dc6c81f94180a99a1490ba9239c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:10Z,use_quota=True,user_id='e91bca07c6a34346b7519d33fe13921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e785ba-474f-48f0-95ed-093550eaa08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e785ba-474f-48f0-95ed-093550eaa08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4916e595-0339-40c7-b010-487b23505698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 1073741824" returned: 0 in 1.292s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:10 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 Jul 03 13:07:10 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4916e595-0339-40c7-b010-487b23505698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '991d8409-81b9-4f32-9514-453bda3d31a3', 'volume_name': 'volume-991d8409-81b9-4f32-9514-453bda3d31a3', 'volume_size': 1, 'image_id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21847457e62cebce1ea3f24f98cd45e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc87dc6c81f94180a99a1490ba9239c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ccb84b61612270bab942174027100ed4c39698fbf5aca59cf949cedefe155bc11ec8186bea7b54e831961d922c50ccd82a83ec40d386f74a73abe2e18020211', 'id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'created_at': datetime.datetime(2026, 7, 3, 11, 7, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7263b4b5-31b2-4c36-8aa4-78354ebfc1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7263b4b5-31b2-4c36-8aa4-78354ebfc1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5816ae0-e9bc-4f3e-9549-3b2f39b5b610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Volume 991d8409-81b9-4f32-9514-453bda3d31a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-991d8409-81b9-4f32-9514-453bda3d31a3', 'volume_size': 1, 'image_id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21847457e62cebce1ea3f24f98cd45e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc87dc6c81f94180a99a1490ba9239c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ccb84b61612270bab942174027100ed4c39698fbf5aca59cf949cedefe155bc11ec8186bea7b54e831961d922c50ccd82a83ec40d386f74a73abe2e18020211', 'id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'created_at': datetime.datetime(2026, 7, 3, 11, 7, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4/file', 'properties': {}}, 'image_service': } Jul 03 13:07:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Trying to clone 991d8409-81b9-4f32-9514-453bda3d31a3 from image 46a411d8-d59f-4227-aa8e-b7df0f99bff4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:07:11 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Image download 0.00 MB at 0.00 MB/s Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a51570-e8ed-48cd-9658-641f9b2202dc]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:11 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD Jul 03 13:07:11 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:11 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756" returned: 0 in 1.156s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.568s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47186978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebc5018-e4b1-4933-874f-11a30756c137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:06Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating volume 1ebc5018-e4b1-4933-874f-11a30756c137 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d39dd1a-178c-491f-b2e5-ba75136f9066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:11 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 1073741824 Jul 03 13:07:11 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b045f2-1beb-417f-991b-7ef27401c368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 (4b9a75ef-3dfe-4e1c-a90b-309b4b37a756): created successfully Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b045f2-1beb-417f-991b-7ef27401c368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (334e606d-642f-4715-aae2-2e6be1ca825a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a32da75e-0ea3-4564-865d-ae68f2fa8c67 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created volume successfully. Jul 03 13:07:12 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD" returned: 0 in 1.165s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:12 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD Jul 03 13:07:12 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:13 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 1073741824" returned: 0 in 1.467s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:13 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 Jul 03 13:07:13 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:13 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD" returned: 1 in 1.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Temporary image 46a411d8-d59f-4227-aa8e-b7df0f99bff4 is fetched for user e91bca07c6a34346b7519d33fe13921b. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1286ae-7fd8-4358-8263-3b866243a000]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:13 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD Jul 03 13:07:13 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:14 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137" returned: 0 in 0.949s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] <== create_volume: return (2487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.298s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334430135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173cfdcf-caa5-44e7-8c34-750535fc2ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102914406c8645938ce4ae4a3ee0be44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:06Z,use_quota=True,user_id='9ceb9ee78a5c40f392c633c4afeb7e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Creating volume 173cfdcf-caa5-44e7-8c34-750535fc2ffa {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:14 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:14 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa 1073741824 Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca46c241-ce8d-4e0c-9100-e1f07c07724a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebc5018-e4b1-4933-874f-11a30756c137', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:14 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3de435-e115-4919-9df5-20467d568b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume volume-1ebc5018-e4b1-4933-874f-11a30756c137 (1ebc5018-e4b1-4933-874f-11a30756c137): created successfully Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3de435-e115-4919-9df5-20467d568b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (7b28c381-c237-4f11-a321-815bfbbad6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-724b3660-1349-4a06-8219-e00942dfdb88 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created volume successfully. Jul 03 13:07:14 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD" returned: 0 in 1.137s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:14 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD Jul 03 13:07:14 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:15 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa 1073741824" returned: 0 in 1.339s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:15 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD" returned: 1 in 1.002s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:07:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:15 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa Jul 03 13:07:15 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:16 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991d8409-81b9-4f32-9514-453bda3d31a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc87dc6c81f94180a99a1490ba9239c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:10Z,use_quota=True,user_id='e91bca07c6a34346b7519d33fe13921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Creating volume 991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57175156-fcd5-4e7f-a7e8-355ddc6f0a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266024a6-b654-45c6-b771-28577b59f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:16 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 1073741824 Jul 03 13:07:16 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Volume volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa (173cfdcf-caa5-44e7-8c34-750535fc2ffa): created successfully Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266024a6-b654-45c6-b771-28577b59f502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Flow 'volume_create_manager' (0f974455-ed34-4ef3-a1e9-85e6d9181b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-759f3980-f1a0-4112-bf5d-02b18891e79f tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created volume successfully. Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-173cfdcf-caa5-44e7-8c34-750535fc2ffa-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-173cfdcf-caa5-44e7-8c34-750535fc2ffa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-173cfdcf-caa5-44e7-8c34-750535fc2ffa" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-173cfdcf-caa5-44e7-8c34-750535fc2ffa" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f054f-d011-4a8a-acd4-21caad892c4b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:17 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa Jul 03 13:07:17 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:17 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 1073741824" returned: 0 in 1.564s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:17 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:17 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:18 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa" returned: 0 in 1.225s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:18 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa Jul 03 13:07:18 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:19 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 0 in 1.175s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] <== create_volume: return (2838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.841s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Attempting download of 46a411d8-d59f-4227-aa8e-b7df0f99bff4 ((None, [{'url': 'file:///opt/stack/data/glance/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'metadata': {}}])) to volume 991d8409-81b9-4f32-9514-453bda3d31a3. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f425e0-fb17-4394-b543-a8f0fba70c91]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:19 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw Jul 03 13:07:19 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:19 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-173cfdcf-caa5-44e7-8c34-750535fc2ffa" returned: 0 in 1.171s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-173cfdcf-caa5-44e7-8c34-750535fc2ffa" released by "delete_volume" :: held 2.477s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['3d747c08-40ec-45e5-94ee-a72558cf6b8e', 'c06a37e5-7005-4338-a90b-c0d5dc13a5da', '1aeb577c-00fd-45bf-b9a9-17ef175c5ed7', 'ff0cc3a8-5618-45f2-ac9c-67cfc72b7348'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:19 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:19 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:20 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw" returned: 0 in 1.146s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-1ebc5018-e4b1-4933-874f-11a30756c137-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-1ebc5018-e4b1-4933-874f-11a30756c137-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:20 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw Jul 03 13:07:20 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-1ebc5018-e4b1-4933-874f-11a30756c137" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:20 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleted volume successfully. Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-1ebc5018-e4b1-4933-874f-11a30756c137" acquired by "delete_volume" :: waited 0.055s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2214ec0-036b-455a-b9e3-69f46326076e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3db46218-ef1c-43c2-b7c6-ea9c50d7a77e tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-173cfdcf-caa5-44e7-8c34-750535fc2ffa-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:20 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 Jul 03 13:07:20 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:21 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw" returned: 1 in 1.132s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46a411d8-d59f-4227-aa8e-b7df0f99bff4_ub9umadw' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:07:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecdbd32-711f-4b90-b9bd-2903ec3769f3]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:21 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD Jul 03 13:07:21 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:21 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137" returned: 0 in 1.129s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:21 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137 Jul 03 13:07:21 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:22 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD" returned: 0 in 1.121s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:22 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD Jul 03 13:07:22 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:23 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-1ebc5018-e4b1-4933-874f-11a30756c137" returned: 0 in 1.110s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-1ebc5018-e4b1-4933-874f-11a30756c137" released by "delete_volume" :: held 2.320s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['9679a14b-39bd-4fff-aeaf-143e5241d9e1', 'aa6c3085-2936-44b9-a579-c5e762e27379', '055bf459-fd77-4305-9942-290d6fb61aac', 'f8ed9468-6554-41ee-bad4-92a3e38a0be0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:23 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:23 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:23 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD" returned: 1 in 1.161s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] 46a411d8-d59f-4227-aa8e-b7df0f99bff4 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:07:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:23 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:23 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42f860-0d63-4c34-993d-32633dbb870d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:24 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.303s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleted volume successfully. Jul 03 13:07:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3b6b13b2-cfa1-495c-8ed8-e7a588a23ce0 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-1ebc5018-e4b1-4933-874f-11a30756c137-delete_volume" released by "delete_volume" :: held 4.040s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:24 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 Jul 03 13:07:24 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:25 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 0 in 1.240s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:25 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46a411d8-d59f-4227-aa8e-b7df0f99bff4_hv57i66odevstack@QuobyteHD, size 0.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:07:25 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 13:07:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:25 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 1G Jul 03 13:07:25 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:25 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756" returned: 0 in 1.257s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:25 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756 Jul 03 13:07:25 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:26 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 1G" returned: 0 in 1.075s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a14c2-d8fb-4a8e-9047-991e243d2fd7]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:26 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:26 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:26 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756" returned: 0 in 0.969s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756" released by "delete_volume" :: held 2.334s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['ae3ae3ed-dc33-46da-9953-dbbb0e567e0d', '2f04a238-e838-47fe-9fcd-f5d1841115cb', 'fa31be73-2fa6-4146-8c1d-5c50bbb673bd', '517e25bf-d884-454c-95ba-b448ca9baf38'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:26 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:26 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:27 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 0 in 1.207s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:27 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:27 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-91de9739-ad41-4a6f-b283-78eb880d3f05-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-91de9739-ad41-4a6f-b283-78eb880d3f05-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-91de9739-ad41-4a6f-b283-78eb880d3f05" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-91de9739-ad41-4a6f-b283-78eb880d3f05" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f5a363-06dc-4b1a-95f6-96418fe9ad3b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:28 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.205s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleted volume successfully. Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-578704ac-17a2-4dde-acba-9f33b864ad07 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-4b9a75ef-3dfe-4e1c-a90b-309b4b37a756-delete_volume" released by "delete_volume" :: held 3.979s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:28 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 Jul 03 13:07:28 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:28 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 1 in 1.298s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Downloaded image 46a411d8-d59f-4227-aa8e-b7df0f99bff4 ((None, [{'url': 'file:///opt/stack/data/glance/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'metadata': {}}])) to volume 991d8409-81b9-4f32-9514-453bda3d31a3 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Temporary image 46a411d8-d59f-4227-aa8e-b7df0f99bff4 for user e91bca07c6a34346b7519d33fe13921b is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Marking volume 991d8409-81b9-4f32-9514-453bda3d31a3 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Copying metadata from image 46a411d8-d59f-4227-aa8e-b7df0f99bff4 to 991d8409-81b9-4f32-9514-453bda3d31a3. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Creating volume glance metadata for volume 991d8409-81b9-4f32-9514-453bda3d31a3 backed by image 46a411d8-d59f-4227-aa8e-b7df0f99bff4 with: {'image_id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '21847457e62cebce1ea3f24f98cd45e6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5816ae0-e9bc-4f3e-9549-3b2f39b5b610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991d8409-81b9-4f32-9514-453bda3d31a3', 'volume_size': 1, 'image_id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21847457e62cebce1ea3f24f98cd45e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc87dc6c81f94180a99a1490ba9239c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ccb84b61612270bab942174027100ed4c39698fbf5aca59cf949cedefe155bc11ec8186bea7b54e831961d922c50ccd82a83ec40d386f74a73abe2e18020211', 'id': '46a411d8-d59f-4227-aa8e-b7df0f99bff4', 'created_at': datetime.datetime(2026, 7, 3, 11, 7, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46a411d8-d59f-4227-aa8e-b7df0f99bff4/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1955f291-768f-40ec-a593-1b15929ca58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Volume volume-991d8409-81b9-4f32-9514-453bda3d31a3 (991d8409-81b9-4f32-9514-453bda3d31a3): created successfully Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1955f291-768f-40ec-a593-1b15929ca58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Flow 'volume_create_manager' (c66d86a2-bc41-4156-b869-0d3a49a8528e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2d5e0431-df41-4c65-aea7-a35d90e7245c tempest-VolumeImageDependencyTests-2069190832 None] Created volume successfully. Jul 03 13:07:29 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05" returned: 0 in 1.298s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:29 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05 Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Acquiring lock "cinder-991d8409-81b9-4f32-9514-453bda3d31a3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:29 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Lock "cinder-991d8409-81b9-4f32-9514-453bda3d31a3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Acquiring lock "cinder-quobyte-991d8409-81b9-4f32-9514-453bda3d31a3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Lock "cinder-quobyte-991d8409-81b9-4f32-9514-453bda3d31a3" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302bcb0-ce5a-454e-8dd1-a8e0d8af92b1]: (4, 'raw') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:29 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:29 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:30 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-91de9739-ad41-4a6f-b283-78eb880d3f05" returned: 0 in 1.282s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-91de9739-ad41-4a6f-b283-78eb880d3f05" released by "delete_volume" :: held 2.653s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['c05d3daf-c69c-40c7-9769-b1808f5b7ee1', '5009f2c5-a7e9-43f9-b82e-53bcd1144a1e', 'f97ece90-9314-4af6-8476-0e00118f11a0', 'b6159a60-eb9f-43ca-97b1-71686cbd36c4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:30 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 0 in 1.265s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:30 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:30 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:31 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:31 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-47d6dea4-ee36-4a33-8ae0-fe95f5297293-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-47d6dea4-ee36-4a33-8ae0-fe95f5297293-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-47d6dea4-ee36-4a33-8ae0-fe95f5297293" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-47d6dea4-ee36-4a33-8ae0-fe95f5297293" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361a052-5f47-45e6-9d74-0ed402e8a38c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:31 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 Jul 03 13:07:31 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:32 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.114s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleted volume successfully. Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b15910a-520d-40e7-a122-7470fd0424ad tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-91de9739-ad41-4a6f-b283-78eb880d3f05-delete_volume" released by "delete_volume" :: held 4.295s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:32 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 1 in 1.287s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:32 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3 Jul 03 13:07:32 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:32 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293" returned: 0 in 1.053s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:32 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293 Jul 03 13:07:32 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:33 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-991d8409-81b9-4f32-9514-453bda3d31a3" returned: 0 in 1.154s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Lock "cinder-quobyte-991d8409-81b9-4f32-9514-453bda3d31a3" released by "delete_volume" :: held 3.807s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Created reservations ['fc5d85d4-10a7-4a99-8f51-816fb0f9942f', '946e5b55-458b-45ab-b7ff-2a7a40fa39e9', '226dd765-e71c-4dff-8b22-dff461f19fae', 'ed784f68-74ed-400a-8beb-6cffbb347d2e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:33 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:33 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:33 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-47d6dea4-ee36-4a33-8ae0-fe95f5297293" returned: 0 in 1.122s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-47d6dea4-ee36-4a33-8ae0-fe95f5297293" released by "delete_volume" :: held 2.270s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['85d825a5-1a40-4912-a3c7-2c66528a1f00', '05a267c0-6725-44a1-a7d9-2e48fa9b1a87', '34a493e7-7611-4a2e-ba3b-bbc5ff553b0d', 'da324dfb-3e02-4fd4-a3f3-498781245338'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:34 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:34 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Flow 'volume_create_manager' (78bd58e5-9476-4ecf-8552-d34a0d04a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544760ba-11c0-4e45-a7c2-f51510ab939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544760ba-11c0-4e45-a7c2-f51510ab939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169956565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a393f7f544243e39610183f4b366e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:34Z,use_quota=True,user_id='452c53c16dc742efbc0f134e47bd4b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a520b5-c4c3-401e-a6e5-783837360732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a520b5-c4c3-401e-a6e5-783837360732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f607e4-29a6-4ad9-9f6e-a131e26e2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f607e4-29a6-4ad9-9f6e-a131e26e2b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5', 'volume_name': 'volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8788beec-fcf5-4fc6-87b6-f3414c748e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8788beec-fcf5-4fc6-87b6-f3414c748e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77149f70-9d1f-4e7b-93fa-11a251fb592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Volume 9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5', 'volume_size': 1} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169956565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a393f7f544243e39610183f4b366e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:34Z,use_quota=True,user_id='452c53c16dc742efbc0f134e47bd4b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Creating volume 9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:34 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:34 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 1073741824 Jul 03 13:07:34 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:34 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.213s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Deleted volume successfully. Jul 03 13:07:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57962b42-4588-43d1-a8a9-ed57ac82d30a tempest-VolumeImageDependencyTests-2069190832 None] Lock "cinder-991d8409-81b9-4f32-9514-453bda3d31a3-delete_volume" released by "delete_volume" :: held 5.395s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-44f61315-ff61-44f6-9502-79f4505f14f4-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-44f61315-ff61-44f6-9502-79f4505f14f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-491f2ba8-99da-4374-8c56-171cad5dc002" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-491f2ba8-99da-4374-8c56-171cad5dc002" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-44f61315-ff61-44f6-9502-79f4505f14f4" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-44f61315-ff61-44f6-9502-79f4505f14f4" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleting offline snapshot 44f61315-ff61-44f6-9502-79f4505f14f4 of volume 491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] snapshot_file for this snap is: volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeb9390-1fb7-428f-b509-2c7f450e2fd2]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:35 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.325s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleted volume successfully. Jul 03 13:07:35 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 Jul 03 13:07:35 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d931b2c-dff3-4449-ae19-520ac0165c56 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-47d6dea4-ee36-4a33-8ae0-fe95f5297293-delete_volume" released by "delete_volume" :: held 4.050s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:36 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 1073741824" returned: 0 in 1.515s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:36 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 Jul 03 13:07:36 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:36 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4" returned: 0 in 1.479s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-491f2ba8-99da-4374-8c56-171cad5dc002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:07:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231e074-6517-4047-9c57-037c7a978516]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:36 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 Jul 03 13:07:36 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:37 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5" returned: 0 in 1.057s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] <== create_volume: return (2649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.657s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77149f70-9d1f-4e7b-93fa-11a251fb592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b73ba71-8c5a-455d-a9d1-f2090392e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Volume volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 (9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5): created successfully Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b73ba71-8c5a-455d-a9d1-f2090392e388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Flow 'volume_create_manager' (78bd58e5-9476-4ecf-8552-d34a0d04a20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a3472f9b-3512-4ec6-8c3e-2781322b9011 tempest-ProjectReaderTests-848474350 None] Created volume successfully. Jul 03 13:07:38 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002" returned: 0 in 1.329s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:38 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 Jul 03 13:07:38 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Acquiring lock "cinder-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Lock "cinder-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Acquiring lock "cinder-quobyte-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Lock "cinder-quobyte-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f443982c-669c-4309-938a-8d51fc93fffe]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:38 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 Jul 03 13:07:38 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:39 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4" returned: 0 in 1.217s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:39 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4 Jul 03 13:07:39 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:39 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5" returned: 0 in 1.178s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:39 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5 Jul 03 13:07:39 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:40 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Flow 'volume_create_manager' (b83cc7fa-f3cf-4f6d-8a2a-7a4d9362722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e4d587-70fb-4b83-9091-ab1e8825d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002.44f61315-ff61-44f6-9502-79f4505f14f4" returned: 0 in 1.154s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e4d587-70fb-4b83-9091-ab1e8825d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75076986548b4770a829e51ad23c3745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:40Z,use_quota=True,user_id='e6b1cbb694714c31817501c1e31d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf52d28-dabe-4b98-94c2-c5de01e007ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf52d28-dabe-4b98-94c2-c5de01e007ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c52d779-bcc2-485d-9c92-a0ae20835975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c52d779-bcc2-485d-9c92-a0ae20835975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae', 'volume_name': 'volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded4f03e-ac02-446d-8b1f-212644a6a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded4f03e-ac02-446d-8b1f-212644a6a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de905701-23e2-4244-9ff3-1b07501c9231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Volume 14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae', 'volume_size': 1} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75076986548b4770a829e51ad23c3745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:40Z,use_quota=True,user_id='e6b1cbb694714c31817501c1e31d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Creating volume 14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:40 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:40 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae 1073741824 Jul 03 13:07:40 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-44f61315-ff61-44f6-9502-79f4505f14f4" released by "_delete_snapshot" :: held 5.465s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-491f2ba8-99da-4374-8c56-171cad5dc002" released by "delete_snapshot" :: held 5.515s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:40 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5" returned: 0 in 1.053s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Lock "cinder-quobyte-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5" released by "delete_volume" :: held 2.297s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['6696281b-14c6-4595-9b9f-f499ac7653b5', '08909a40-a78e-45b2-9708-e31685b285eb', '4c6cfdbc-0537-4fe6-98d9-477fa98c3451', 'e9a1a226-e197-493c-a22e-e0023f0429e3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:40 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Created reservations ['9fac0feb-3464-496b-96f6-ce6213c82b94', '58c55f81-b842-42b4-8e2f-62fa71a02fdd', 'f6f327da-5b2e-4033-9107-64fce27d1b4f', 'a3d5f322-1977-4867-a5fd-191c2f1fe807'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Delete snapshot completed successfully. Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0699fd89-fc4d-4cc9-bed5-e153f089e142 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-44f61315-ff61-44f6-9502-79f4505f14f4-delete_snapshot" released by "delete_snapshot" :: held 5.996s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:41 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:41 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-491f2ba8-99da-4374-8c56-171cad5dc002-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-491f2ba8-99da-4374-8c56-171cad5dc002-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "cinder-quobyte-491f2ba8-99da-4374-8c56-171cad5dc002" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-491f2ba8-99da-4374-8c56-171cad5dc002" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3d4cb0-382b-4160-9173-75d791f6ed63]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:41 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 Jul 03 13:07:41 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:41 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae 1073741824" returned: 0 in 1.387s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:42 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae Jul 03 13:07:42 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:42 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.164s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Deleted volume successfully. Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c92291-47df-4526-a994-656f01858e65 tempest-ProjectReaderTests-848474350 None] Lock "cinder-9717d5c4-66c7-4dd6-8ccc-a81f4a3808f5-delete_volume" released by "delete_volume" :: held 3.894s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Flow 'volume_create_manager' (60489085-47ed-4181-a080-88f92ad1dca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494aa1bf-5db0-4b00-ab4c-e1be1b4faf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494aa1bf-5db0-4b00-ab4c-e1be1b4faf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-969162398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7caf34c1-eeec-41c7-8659-da5effaa78aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a393f7f544243e39610183f4b366e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:43Z,use_quota=True,user_id='452c53c16dc742efbc0f134e47bd4b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb23aca-c9da-4fcf-a1c4-a48e34c779d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb23aca-c9da-4fcf-a1c4-a48e34c779d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b007c8-ae81-4ab9-bb71-a4f155e8233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b007c8-ae81-4ab9-bb71-a4f155e8233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7caf34c1-eeec-41c7-8659-da5effaa78aa', 'volume_name': 'volume-7caf34c1-eeec-41c7-8659-da5effaa78aa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9a9dc1-4ddb-4898-aff7-2ca46c3160c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9a9dc1-4ddb-4898-aff7-2ca46c3160c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2beed676-7a60-4d38-9332-80ec1d234107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Volume 7caf34c1-eeec-41c7-8659-da5effaa78aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7caf34c1-eeec-41c7-8659-da5effaa78aa', 'volume_size': 1} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:42 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002" returned: 0 in 1.108s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:42 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002 Jul 03 13:07:42 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:42 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae" returned: 0 in 0.947s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] <== create_volume: return (2383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.387s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-969162398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7caf34c1-eeec-41c7-8659-da5effaa78aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a393f7f544243e39610183f4b366e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:43Z,use_quota=True,user_id='452c53c16dc742efbc0f134e47bd4b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Creating volume 7caf34c1-eeec-41c7-8659-da5effaa78aa {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:42 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de905701-23e2-4244-9ff3-1b07501c9231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27938334-05cc-4c9c-93b0-5374d57ce038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:42 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa 1073741824 Jul 03 13:07:42 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Volume volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae (14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae): created successfully Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27938334-05cc-4c9c-93b0-5374d57ce038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Flow 'volume_create_manager' (b83cc7fa-f3cf-4f6d-8a2a-7a4d9362722e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1f87541b-e313-49a5-8adc-75b4e86d4a59 tempest-CinderUnicodeTest-1768594443 None] Created volume successfully. Jul 03 13:07:43 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-491f2ba8-99da-4374-8c56-171cad5dc002" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-quobyte-491f2ba8-99da-4374-8c56-171cad5dc002" released by "delete_volume" :: held 2.120s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Created reservations ['1dcca98b-cdba-47dd-83f8-4b32e5a77f51', '4e8912b0-04aa-4854-9212-c43d639610d1', 'e92a5651-8e62-453d-8aaa-606a8fc72719', '85c84a29-8b69-436d-bf60-a07ad85fc7e8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:44 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:44 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:44 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa 1073741824" returned: 0 in 1.291s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:44 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa Jul 03 13:07:44 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Flow 'volume_create_manager' (9eca5025-4ad1-49ce-b50c-e9fe8d1f508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c089359-2f17-4cce-b76f-0f13047f16e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c089359-2f17-4cce-b76f-0f13047f16e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-682899323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222ce683-a749-43ba-b8ae-7faec64a9fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75076986548b4770a829e51ad23c3745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:45Z,use_quota=True,user_id='e6b1cbb694714c31817501c1e31d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b18f5b2-a353-4b75-8c35-7d1e50c819e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b18f5b2-a353-4b75-8c35-7d1e50c819e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9a36ec-ae7c-43f5-857b-f06ffa1ecfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9a36ec-ae7c-43f5-857b-f06ffa1ecfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222ce683-a749-43ba-b8ae-7faec64a9fec', 'volume_name': 'volume-222ce683-a749-43ba-b8ae-7faec64a9fec', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c75acb-16f5-47d8-aeac-1b4a0d54cd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c75acb-16f5-47d8-aeac-1b4a0d54cd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a2629b-e3f1-43a3-8602-6c37ee8b5d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Volume 222ce683-a749-43ba-b8ae-7faec64a9fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222ce683-a749-43ba-b8ae-7faec64a9fec', 'volume_size': 1} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:44 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Deleted volume successfully. Jul 03 13:07:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3509cb0e-4eee-4ffe-aff1-f30df3f2cd30 tempest-CreateVolumesFromSnapshotTest-1203913914 None] Lock "cinder-491f2ba8-99da-4374-8c56-171cad5dc002-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:45 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa" returned: 0 in 1.007s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-682899323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222ce683-a749-43ba-b8ae-7faec64a9fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75076986548b4770a829e51ad23c3745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:45Z,use_quota=True,user_id='e6b1cbb694714c31817501c1e31d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Creating volume 222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:45 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2beed676-7a60-4d38-9332-80ec1d234107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7caf34c1-eeec-41c7-8659-da5effaa78aa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:45 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec 1073741824 Jul 03 13:07:45 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd6027c-c184-43cb-94c5-4dd15214f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Volume volume-7caf34c1-eeec-41c7-8659-da5effaa78aa (7caf34c1-eeec-41c7-8659-da5effaa78aa): created successfully Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd6027c-c184-43cb-94c5-4dd15214f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Flow 'volume_create_manager' (60489085-47ed-4181-a080-88f92ad1dca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-17729cdf-e481-4656-ba5e-535446054e9d tempest-ProjectReaderTests-848474350 None] Created volume successfully. Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Acquiring lock "cinder-7caf34c1-eeec-41c7-8659-da5effaa78aa-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Lock "cinder-7caf34c1-eeec-41c7-8659-da5effaa78aa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Acquiring lock "cinder-quobyte-7caf34c1-eeec-41c7-8659-da5effaa78aa" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Lock "cinder-quobyte-7caf34c1-eeec-41c7-8659-da5effaa78aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d953287-a093-4b9e-b95c-3cd6ec434b9b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:46 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa Jul 03 13:07:46 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:46 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec 1073741824" returned: 0 in 1.558s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:47 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec Jul 03 13:07:47 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:47 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa" returned: 0 in 1.207s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:47 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa Jul 03 13:07:47 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:48 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec" returned: 0 in 1.028s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.688s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a2629b-e3f1-43a3-8602-6c37ee8b5d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222ce683-a749-43ba-b8ae-7faec64a9fec', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffd006c-f77e-456b-98ce-5c7213f3f92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Volume volume-222ce683-a749-43ba-b8ae-7faec64a9fec (222ce683-a749-43ba-b8ae-7faec64a9fec): created successfully Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffd006c-f77e-456b-98ce-5c7213f3f92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Flow 'volume_create_manager' (9eca5025-4ad1-49ce-b50c-e9fe8d1f508f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a88f670a-f102-4519-84ea-34bee439903a tempest-CinderUnicodeTest-1768594443 None] Created volume successfully. Jul 03 13:07:48 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7caf34c1-eeec-41c7-8659-da5effaa78aa" returned: 0 in 1.143s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Lock "cinder-quobyte-7caf34c1-eeec-41c7-8659-da5effaa78aa" released by "delete_volume" :: held 2.415s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Created reservations ['b56d96e3-a41e-4c72-800b-4d0d05e17066', '3cbcb0aa-01d0-4e59-8788-650f6d4b5e59', 'a7ff4181-43ff-42b5-9d0d-ce79d9c89b58', 'da747f7b-af80-4634-b79c-7fd7b0b84725'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:48 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:07:48 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Creating offline snapshot c5b084ca-d4a2-4f22-93ff-73a48c446ee8 of volume 222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe4358a-0740-4a59-8aa4-dcd183146182]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:49 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec Jul 03 13:07:49 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:49 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.999s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:07:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Deleted volume successfully. Jul 03 13:07:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-66fecb6d-17b1-4920-9384-bbc33325c6fb tempest-ProjectReaderTests-848474350 None] Lock "cinder-7caf34c1-eeec-41c7-8659-da5effaa78aa-delete_volume" released by "delete_volume" :: held 3.758s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:07:50 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec" returned: 0 in 1.256s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:50 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 1G Jul 03 13:07:50 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d2dde8c2-c5f3-4fff-824c-9fa81a9961ce tempest-ProjectAdminTests-1758346498 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7511024475098, 'free_capacity_gb': 1775.7511024475098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Flow 'volume_create_manager' (c1955e22-55a2-416a-9888-e8d3677a0c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671891e6-6550-4427-83e7-229b0c631b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:51 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671891e6-6550-4427-83e7-229b0c631b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-639799376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba94c75-1564-4289-ad12-e7af56fc7590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1f43edac344e188a90800dc57866ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:52Z,use_quota=True,user_id='ff0fc9f362c040e5b89be9fee89271ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ac64d2-1f49-401b-8b19-efa942af95a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ac64d2-1f49-401b-8b19-efa942af95a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77874cd4-1446-4e87-ad67-f7a0efd4edde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77874cd4-1446-4e87-ad67-f7a0efd4edde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba94c75-1564-4289-ad12-e7af56fc7590', 'volume_name': 'volume-eba94c75-1564-4289-ad12-e7af56fc7590', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d9eff6-0500-4248-8900-77e470681dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d9eff6-0500-4248-8900-77e470681dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9f7235-38c2-4951-a57b-46e3418fd234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Volume eba94c75-1564-4289-ad12-e7af56fc7590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba94c75-1564-4289-ad12-e7af56fc7590', 'volume_size': 1} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 1G" returned: 0 in 1.111s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222ce683-a749-43ba-b8ae-7faec64a9fec -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:51 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222ce683-a749-43ba-b8ae-7faec64a9fec -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 Jul 03 13:07:51 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:52 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222ce683-a749-43ba-b8ae-7faec64a9fec -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8" returned: 0 in 1.027s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:52 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 is being set with open permissions: ugo+rw Jul 03 13:07:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:52 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 Jul 03 13:07:52 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:53 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8" returned: 0 in 0.789s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:53 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info Jul 03 13:07:53 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:54 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info is being set with open permissions: ugo+rw Jul 03 13:07:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:54 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info Jul 03 13:07:54 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:55 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.info" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.133s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.691s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-639799376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba94c75-1564-4289-ad12-e7af56fc7590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1f43edac344e188a90800dc57866ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:52Z,use_quota=True,user_id='ff0fc9f362c040e5b89be9fee89271ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Creating volume eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:55 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:55 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 1073741824 Jul 03 13:07:55 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8244d750-c24e-44e5-a593-2a165441ba7a tempest-CinderUnicodeTest-1768594443 None] Create snapshot completed successfully Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-c5b084ca-d4a2-4f22-93ff-73a48c446ee8-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-c5b084ca-d4a2-4f22-93ff-73a48c446ee8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-quobyte-222ce683-a749-43ba-b8ae-7faec64a9fec" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-222ce683-a749-43ba-b8ae-7faec64a9fec" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-quobyte-c5b084ca-d4a2-4f22-93ff-73a48c446ee8" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-c5b084ca-d4a2-4f22-93ff-73a48c446ee8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:07:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Deleting offline snapshot c5b084ca-d4a2-4f22-93ff-73a48c446ee8 of volume 222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:07:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] snapshot_file for this snap is: volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:07:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b7719-8656-4991-ad0b-59390b0a38f5]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:56 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 Jul 03 13:07:56 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:56 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 1073741824" returned: 0 in 1.439s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:57 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:07:57 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:57 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8" returned: 0 in 1.147s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-222ce683-a749-43ba-b8ae-7faec64a9fec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:07:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3f11b4-cd83-4aba-ae63-2d9bf71bce68]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:07:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:57 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec Jul 03 13:07:57 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:58 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (56ff9184-7570-4486-a3ed-57ac8d44773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443760d6-49c3-414e-841d-cde84fe0c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 1.027s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] <== create_volume: return (2538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.541s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443760d6-49c3-414e-841d-cde84fe0c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443259312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0cf53a-6ff4-4120-a357-df0364f37c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:58Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c5d7c0-2439-4e8d-8bbb-b14f3d15fc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c5d7c0-2439-4e8d-8bbb-b14f3d15fc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73998a7f-134a-4849-b1a8-4cd335e58bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73998a7f-134a-4849-b1a8-4cd335e58bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0cf53a-6ff4-4120-a357-df0364f37c80', 'volume_name': 'volume-aa0cf53a-6ff4-4120-a357-df0364f37c80', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d48bc9-b36f-46ef-8631-72fa19c44b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d48bc9-b36f-46ef-8631-72fa19c44b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746b70ff-d0d1-4697-bfc9-0dc0a7902176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Volume aa0cf53a-6ff4-4120-a357-df0364f37c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0cf53a-6ff4-4120-a357-df0364f37c80', 'volume_size': 1} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443259312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0cf53a-6ff4-4120-a357-df0364f37c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:58Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Creating volume aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:07:58 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9f7235-38c2-4951-a57b-46e3418fd234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba94c75-1564-4289-ad12-e7af56fc7590', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:58 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 1073741824 Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4d9321-4cf7-4515-8c7c-49a303eb38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:07:58 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Volume volume-eba94c75-1564-4289-ad12-e7af56fc7590 (eba94c75-1564-4289-ad12-e7af56fc7590): created successfully Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4d9321-4cf7-4515-8c7c-49a303eb38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Flow 'volume_create_manager' (c1955e22-55a2-416a-9888-e8d3677a0c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:07:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-39950391-9638-421f-9064-d81598675af1 tempest-SnapshotDependencyTests-1775348507 None] Created volume successfully. Jul 03 13:07:58 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec" returned: 0 in 1.163s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:58 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 Jul 03 13:07:58 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:59 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 1073741824" returned: 0 in 1.061s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:59 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 Jul 03 13:07:59 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:59 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 03 13:07:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8" returned: 0 in 0.958s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:07:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:07:59 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8 Jul 03 13:07:59 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:07:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:00 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746b70ff-d0d1-4697-bfc9-0dc0a7902176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0cf53a-6ff4-4120-a357-df0364f37c80', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd5f6d5-c44f-4a02-a4cc-ef4d44530f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Creating offline snapshot 0e57993d-e76d-4fba-a419-9832b02487fd of volume eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Volume volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 (aa0cf53a-6ff4-4120-a357-df0364f37c80): created successfully Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd5f6d5-c44f-4a02-a4cc-ef4d44530f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (56ff9184-7570-4486-a3ed-57ac8d44773f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cc073-8897-4f5a-9020-e68481b77f4f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7b4e38c4-b577-41c6-a53a-aa5433dc62f5 tempest-ProjectReaderTests-1350651292 None] Created volume successfully. Jul 03 13:08:00 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec.c5b084ca-d4a2-4f22-93ff-73a48c446ee8" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-c5b084ca-d4a2-4f22-93ff-73a48c446ee8" released by "_delete_snapshot" :: held 4.384s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-222ce683-a749-43ba-b8ae-7faec64a9fec" released by "delete_snapshot" :: held 4.434s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:00 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:08:00 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Created reservations ['bc7ac0c4-0073-4fd0-bc6b-035624e7f955', '169de481-1e94-4f12-9aef-bc2975d76bec', 'b455c872-748e-4886-aa88-ad87b9a69d5b', '0a74b08e-295e-4360-a734-4e5dcef0b2e2'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Delete snapshot completed successfully. Jul 03 13:08:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc436b7-2bae-4195-957c-379f62e34b55 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-c5b084ca-d4a2-4f22-93ff-73a48c446ee8-delete_snapshot" released by "delete_snapshot" :: held 4.627s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:01 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:01 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd 1G Jul 03 13:08:01 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-222ce683-a749-43ba-b8ae-7faec64a9fec-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-222ce683-a749-43ba-b8ae-7faec64a9fec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-quobyte-222ce683-a749-43ba-b8ae-7faec64a9fec" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-222ce683-a749-43ba-b8ae-7faec64a9fec" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced0aafa-095c-4f73-97ba-6e33c60e7aa1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:01 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec Jul 03 13:08:01 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:02 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:02 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:02 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd 1G" returned: 0 in 1.070s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba94c75-1564-4289-ad12-e7af56fc7590 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:02 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba94c75-1564-4289-ad12-e7af56fc7590 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd Jul 03 13:08:02 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:02 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec" returned: 0 in 0.947s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:02 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec Jul 03 13:08:02 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:02 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:03 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba94c75-1564-4289-ad12-e7af56fc7590 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd" returned: 0 in 0.878s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd is being set with open permissions: ugo+rw Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:03 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd Jul 03 13:08:03 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:03 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-222ce683-a749-43ba-b8ae-7faec64a9fec" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-222ce683-a749-43ba-b8ae-7faec64a9fec" released by "delete_volume" :: held 1.772s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Created reservations ['9069653d-50c6-4d26-ab7e-121c7cb2e40f', 'daf04e4b-27c9-4865-bdb1-8e03ce2bcb01', '66de6fb3-25a8-44e6-a8b0-1c342b6d20d1', 'be1570b8-859b-44e3-83cd-5e175b1a1929'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:03 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:03 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "cinder-quobyte-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a55c6f-8176-4378-8889-7aa549aa9a3d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:04 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae Jul 03 13:08:04 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:04 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:04 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info Jul 03 13:08:04 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:04 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Deleted volume successfully. Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-500f4c41-7ec5-49a0-8f9f-05d74e1cfe06 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-222ce683-a749-43ba-b8ae-7faec64a9fec-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:04 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae" returned: 0 in 1.015s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:04 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae Jul 03 13:08:04 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:05 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info" returned: 0 in 0.898s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:05 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info is being set with open permissions: ugo+rw Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:05 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info Jul 03 13:08:05 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:05 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-quobyte-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae" released by "delete_volume" :: held 1.815s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=128,cinder:SELECT=97,cinder:INSERT=39,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Created reservations ['544af520-623b-40d8-838d-0759639b5c46', 'f1530e50-229f-4dd5-88a8-bf83c53d4f08', 'f012c99e-9d3c-4d60-bfdc-218ac8699a69', 'f91e641e-a794-4cb1-84a7-31ba355343e5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:05 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.info" returned: 0 in 0.713s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.627s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.364s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Creating offline snapshot d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f of volume aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7a7dffe5-380d-4ae7-8555-73f6e91974b2 tempest-SnapshotDependencyTests-1775348507 None] Create snapshot completed successfully Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfba06f-1068-4e42-afea-092a246b9ee7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:05 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:05 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:05 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 Jul 03 13:08:05 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:06 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Deleted volume successfully. Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1e70cb6e-98fa-42ff-a607-438fd0b0d205 tempest-CinderUnicodeTest-1768594443 None] Lock "cinder-14aaaf30-3d4c-4b76-bc0f-75fb6c9499ae-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:DELETE=18,cinder:UPDATE=155,cinder:SELECT=109,cinder:INSERT=37 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:08:06 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Flow 'volume_create_manager' (9fa7609d-126d-430e-9af1-f10b9091fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c36289-c636-430e-b81b-e1e862076147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80" returned: 0 in 1.139s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c36289-c636-430e-b81b-e1e862076147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4f7536-bde0-4a00-bbed-f080c5153846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1f43edac344e188a90800dc57866ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e57993d-e76d-4fba-a419-9832b02487fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:07Z,use_quota=True,user_id='ff0fc9f362c040e5b89be9fee89271ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:07 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f 1G Jul 03 13:08:07 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43c047b-8609-4ae3-8933-a045d153428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43c047b-8609-4ae3-8933-a045d153428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac14c41-be70-4ca3-b402-f69328db343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac14c41-be70-4ca3-b402-f69328db343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d4f7536-bde0-4a00-bbed-f080c5153846', 'volume_name': 'volume-7d4f7536-bde0-4a00-bbed-f080c5153846', 'volume_size': 1, 'snapshot_id': '0e57993d-e76d-4fba-a419-9832b02487fd'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46a2bc5-c3f8-498d-b472-04a79c083b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46a2bc5-c3f8-498d-b472-04a79c083b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf07c53-d586-4fc9-bd3a-5930368b283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Volume 7d4f7536-bde0-4a00-bbed-f080c5153846: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d4f7536-bde0-4a00-bbed-f080c5153846', 'volume_size': 1, 'snapshot_id': '0e57993d-e76d-4fba-a419-9832b02487fd'} Jul 03 13:08:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:08 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f 1G" returned: 0 in 1.074s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:08 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f Jul 03 13:08:08 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:08 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f is being set with open permissions: ugo+rw Jul 03 13:08:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:08 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f Jul 03 13:08:08 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:09 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" returned: 0 in 0.747s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:09 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info Jul 03 13:08:09 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:10 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info" returned: 0 in 0.794s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:10 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info is being set with open permissions: ugo+rw Jul 03 13:08:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:10 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info Jul 03 13:08:10 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:11 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.info" returned: 0 in 0.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.496s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.163s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-quobyte-0e57993d-e76d-4fba-a419-9832b02487fd-7d4f7536-bde0-4a00-bbed-f080c5153846" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-0e57993d-e76d-4fba-a419-9832b02487fd-7d4f7536-bde0-4a00-bbed-f080c5153846" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Creating volume 7d4f7536-bde0-4a00-bbed-f080c5153846 from snapshot 0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-quobyte-7d4f7536-bde0-4a00-bbed-f080c5153846" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-7d4f7536-bde0-4a00-bbed-f080c5153846" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] snapshot: 0e57993d-e76d-4fba-a419-9832b02487fd, volume: 7d4f7536-bde0-4a00-bbed-f080c5153846, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0ee13715-209c-42e9-bf4f-e9efacf85e67 tempest-ProjectReaderTests-1350651292 None] Create snapshot completed successfully Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3092ba64-878d-40f7-8d90-4ddaf4a24876]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:11 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd Jul 03 13:08:11 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:12 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba94c75-1564-4289-ad12-e7af56fc7590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eb5b39-a436-4269-b435-2ef9e9e64140]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:12 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:08:12 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-aa0cf53a-6ff4-4120-a357-df0364f37c80" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-aa0cf53a-6ff4-4120-a357-df0364f37c80" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Deleting offline snapshot d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f of volume aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] snapshot_file for this snap is: volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f64e83-edc9-4c76-bab0-481d7efaa552]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:12 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f Jul 03 13:08:12 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:13 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Path /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:13 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 Jul 03 13:08:13 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:13 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" returned: 0 in 0.863s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa0cf53a-6ff4-4120-a357-df0364f37c80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6901cd-7a62-418c-81b0-a89160a61841]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:13 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 Jul 03 13:08:13 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:14 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80" returned: 0 in 1.135s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:14 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f Jul 03 13:08:14 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:16 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" returned: 0 in 1.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:16 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f Jul 03 13:08:16 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:18 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80.d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" returned: 0 in 2.041s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f" released by "_delete_snapshot" :: held 6.091s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-aa0cf53a-6ff4-4120-a357-df0364f37c80" released by "delete_snapshot" :: held 6.136s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Created reservations ['1fcf8db2-1cac-477b-961e-2514634dada7', '761ef732-1e7c-4177-8673-cb76d13bd02f', 'b2987b20-7758-4d00-88c5-f45f93887dec', '1c295e7e-234c-46c7-83b0-132884e0b94c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:19 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846" returned: 0 in 5.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Delete snapshot completed successfully. Jul 03 13:08:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49bf6bb-8db4-4abd-a787-b9085bf910e8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a3fcc846-3f61-46c3-aef7-2e7d9c01c18f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-d5bb1aa0-17bb-449f-b8aa-fe1cc1742b9f-delete_snapshot" released by "delete_snapshot" :: held 6.493s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:19 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:08:19 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:20 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 1.057s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Image conversion details: src /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:08:20 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Converted 1024.00 MB image at 172.75 MB/s Jul 03 13:08:20 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 is being set with open permissions: ugo+rw Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-aa0cf53a-6ff4-4120-a357-df0364f37c80-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:20 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-aa0cf53a-6ff4-4120-a357-df0364f37c80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:20 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-aa0cf53a-6ff4-4120-a357-df0364f37c80" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-aa0cf53a-6ff4-4120-a357-df0364f37c80" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f9e43-90d6-44e2-9d8c-7b3853c9c0f0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:20 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 Jul 03 13:08:20 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:21 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-7d4f7536-bde0-4a00-bbed-f080c5153846" released by "_copy_volume_from_snapshot" :: held 9.672s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-0e57993d-e76d-4fba-a419-9832b02487fd-7d4f7536-bde0-4a00-bbed-f080c5153846" released by "_create_volume_from_snapshot" :: held 9.716s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.746s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf07c53-d586-4fc9-bd3a-5930368b283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4f7536-bde0-4a00-bbed-f080c5153846', 'volume_size': 1, 'snapshot_id': '0e57993d-e76d-4fba-a419-9832b02487fd'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50152216-3aad-416a-b4ad-38ac11061422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Volume volume-7d4f7536-bde0-4a00-bbed-f080c5153846 (7d4f7536-bde0-4a00-bbed-f080c5153846): created successfully Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50152216-3aad-416a-b4ad-38ac11061422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Flow 'volume_create_manager' (9fa7609d-126d-430e-9af1-f10b9091fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f153e194-f11f-4c2f-9ac8-eca4f7b3cb25 tempest-SnapshotDependencyTests-1775348507 None] Created volume successfully. Jul 03 13:08:21 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:21 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80 Jul 03 13:08:21 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (52c2ba26-7a8d-4412-9253-d2e3b7bfbe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50abdf52-a4bc-4306-9510-4ac86de43196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50abdf52-a4bc-4306-9510-4ac86de43196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468833281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237c3105-aa77-4de4-9170-47b7060875a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:22Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0842471-9cab-4585-8fd9-1ddce65068f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0842471-9cab-4585-8fd9-1ddce65068f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e15b3f-21a7-43f9-8d84-5d44608d4aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e15b3f-21a7-43f9-8d84-5d44608d4aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237c3105-aa77-4de4-9170-47b7060875a6', 'volume_name': 'volume-237c3105-aa77-4de4-9170-47b7060875a6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350a80fd-4139-4fd1-a768-6652487f808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350a80fd-4139-4fd1-a768-6652487f808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc6cfc9-218d-4651-9a7f-19ebb18cc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Volume 237c3105-aa77-4de4-9170-47b7060875a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237c3105-aa77-4de4-9170-47b7060875a6', 'volume_size': 1} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468833281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237c3105-aa77-4de4-9170-47b7060875a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:22Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Creating volume 237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:08:21 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:08:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:21 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 1073741824 Jul 03 13:08:21 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:22 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-aa0cf53a-6ff4-4120-a357-df0364f37c80" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-aa0cf53a-6ff4-4120-a357-df0364f37c80" released by "delete_volume" :: held 1.749s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Created reservations ['199c1902-db07-490d-ba66-0baf9b8a4aa7', '728c3b8a-835f-42e0-93ab-6cf2f92240ff', '33daa617-efe8-4a02-8344-30d1a9c2d100', 'bf49e30f-5fc7-46c3-b2b9-14924152e1ce'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:22 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:22 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-0e57993d-e76d-4fba-a419-9832b02487fd-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-0e57993d-e76d-4fba-a419-9832b02487fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-quobyte-eba94c75-1564-4289-ad12-e7af56fc7590" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-eba94c75-1564-4289-ad12-e7af56fc7590" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-quobyte-0e57993d-e76d-4fba-a419-9832b02487fd" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-0e57993d-e76d-4fba-a419-9832b02487fd" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Deleting offline snapshot 0e57993d-e76d-4fba-a419-9832b02487fd of volume eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] snapshot_file for this snap is: volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bdd0f2-6af8-4dcd-b141-91bf67a448dd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:22 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd Jul 03 13:08:22 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:23 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 1073741824" returned: 0 in 1.252s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:23 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 1.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:23 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 Jul 03 13:08:23 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Deleted volume successfully. Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f082d473-40d5-45fa-8615-481c85a5378f tempest-ProjectReaderTests-1350651292 None] Lock "cinder-aa0cf53a-6ff4-4120-a357-df0364f37c80-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (adee95b6-91fe-4768-9bea-d1da936bd572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a5d891-2db3-485c-8ee2-465e4fbf59a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a5d891-2db3-485c-8ee2-465e4fbf59a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762055747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a7f8d6-00e4-4a23-866c-1a591e941601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:23Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be893656-89d6-4937-8174-f0bd2366f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be893656-89d6-4937-8174-f0bd2366f83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9800990f-fbe0-4d62-acdc-84aaa99542d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9800990f-fbe0-4d62-acdc-84aaa99542d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a7f8d6-00e4-4a23-866c-1a591e941601', 'volume_name': 'volume-79a7f8d6-00e4-4a23-866c-1a591e941601', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ede26f-ce0a-4987-8ebe-e9e5399e1d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ede26f-ce0a-4987-8ebe-e9e5399e1d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ab3965-dba5-447e-be82-d5d9f654f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:23 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Volume 79a7f8d6-00e4-4a23-866c-1a591e941601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a7f8d6-00e4-4a23-866c-1a591e941601', 'volume_size': 1} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:23 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd" returned: 0 in 1.237s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba94c75-1564-4289-ad12-e7af56fc7590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6517b36-1e1e-4775-b574-4ec64bcd75d0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:23 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:08:23 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:24 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762055747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a7f8d6-00e4-4a23-866c-1a591e941601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:23Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Creating volume 79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:08:24 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:24 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 1073741824 Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc6cfc9-218d-4651-9a7f-19ebb18cc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237c3105-aa77-4de4-9170-47b7060875a6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:24 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66a1972-935b-4d0b-adfd-98280ccd2a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Volume volume-237c3105-aa77-4de4-9170-47b7060875a6 (237c3105-aa77-4de4-9170-47b7060875a6): created successfully Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66a1972-935b-4d0b-adfd-98280ccd2a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (52c2ba26-7a8d-4412-9253-d2e3b7bfbe96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ab3c685d-861f-4039-af00-af46c0372bcf tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:08:24 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 0.973s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:24 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd Jul 03 13:08:24 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:25 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 1073741824" returned: 0 in 1.073s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:25 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 Jul 03 13:08:25 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:25 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd" returned: 0 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:25 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd Jul 03 13:08:25 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:26 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601" returned: 0 in 0.885s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.648s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ab3965-dba5-447e-be82-d5d9f654f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a7f8d6-00e4-4a23-866c-1a591e941601', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae52c04-4db8-42c4-8f25-cbaf08f868e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 519b3b5b-8edd-4171-b860-593168ef2974 of volume 237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Volume volume-79a7f8d6-00e4-4a23-866c-1a591e941601 (79a7f8d6-00e4-4a23-866c-1a591e941601): created successfully Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae52c04-4db8-42c4-8f25-cbaf08f868e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (adee95b6-91fe-4768-9bea-d1da936bd572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa150ff1-8666-46f8-afce-ca6379572e5f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-05dbf5c4-288a-458f-aa56-a25cfbcb3c6f tempest-ProjectReaderTests-1350651292 None] Created volume successfully. Jul 03 13:08:26 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 Jul 03 13:08:26 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:26 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590.0e57993d-e76d-4fba-a419-9832b02487fd" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-0e57993d-e76d-4fba-a419-9832b02487fd" released by "_delete_snapshot" :: held 4.142s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-eba94c75-1564-4289-ad12-e7af56fc7590" released by "delete_snapshot" :: held 4.189s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Created reservations ['9dc38012-a188-4dcb-b78c-094fa88afc71', '025dcf35-fcd3-44b5-bd6b-1b1c9a56b8fb', 'eda49fd6-2c2e-47f3-bae3-c05e89f39629', 'fb7c2564-e608-4d95-a829-a5e903b6587a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Delete snapshot completed successfully. Jul 03 13:08:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-19711493-43fe-4b36-8b13-b6981747ae04 tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-0e57993d-e76d-4fba-a419-9832b02487fd-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:27 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6" returned: 0 in 0.957s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:27 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 1G Jul 03 13:08:27 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-eba94c75-1564-4289-ad12-e7af56fc7590-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-eba94c75-1564-4289-ad12-e7af56fc7590-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-quobyte-eba94c75-1564-4289-ad12-e7af56fc7590" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-eba94c75-1564-4289-ad12-e7af56fc7590" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e4afd8-f435-40c6-b74f-50fc2b9b435a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:28 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:08:28 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:28 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 1G" returned: 0 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-237c3105-aa77-4de4-9170-47b7060875a6 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:28 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-237c3105-aa77-4de4-9170-47b7060875a6 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 Jul 03 13:08:28 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:28 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 0.973s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:28 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590 Jul 03 13:08:28 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:29 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-237c3105-aa77-4de4-9170-47b7060875a6 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974" returned: 0 in 0.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:29 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 is being set with open permissions: ugo+rw Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:29 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 Jul 03 13:08:29 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:29 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eba94c75-1564-4289-ad12-e7af56fc7590" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-eba94c75-1564-4289-ad12-e7af56fc7590" released by "delete_volume" :: held 1.830s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Created reservations ['a1f3fa81-9df9-4599-9682-e59509618788', '3957d892-f198-4a91-b4a8-f0aa17256e41', '1db47231-3ee1-427c-8a04-fc6d414ae9d3', 'f5ed1918-4660-47af-a85b-41916b3c6d02'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:29 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:29 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info Jul 03 13:08:29 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:29 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:29 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-7d4f7536-bde0-4a00-bbed-f080c5153846-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-7d4f7536-bde0-4a00-bbed-f080c5153846-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "cinder-quobyte-7d4f7536-bde0-4a00-bbed-f080c5153846" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-7d4f7536-bde0-4a00-bbed-f080c5153846" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[88293b15-9f6a-40fa-93c3-2c4dd378da02]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:30 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 Jul 03 13:08:30 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:30 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:30 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info is being set with open permissions: ugo+rw Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:30 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info Jul 03 13:08:30 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:30 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Deleted volume successfully. Jul 03 13:08:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c90377bf-ec2a-43b3-b48f-5ba03e0b861e tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-eba94c75-1564-4289-ad12-e7af56fc7590-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:31 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846" returned: 0 in 0.949s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:31 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846 Jul 03 13:08:31 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:31 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.info" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.356s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.806s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Creating offline snapshot b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb of volume 79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[41789468-51f5-4d75-b3ee-68fd5f6539fb]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8aea873d-b7be-4b4f-bbce-69d7684400af tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:31 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 Jul 03 13:08:31 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-519b3b5b-8edd-4171-b860-593168ef2974-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Lock "cinder-519b3b5b-8edd-4171-b860-593168ef2974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-237c3105-aa77-4de4-9170-47b7060875a6" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-237c3105-aa77-4de4-9170-47b7060875a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-519b3b5b-8edd-4171-b860-593168ef2974" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-519b3b5b-8edd-4171-b860-593168ef2974" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 519b3b5b-8edd-4171-b860-593168ef2974 of volume 237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:08:32 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-7d4f7536-bde0-4a00-bbed-f080c5153846" returned: 0 in 0.860s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-quobyte-7d4f7536-bde0-4a00-bbed-f080c5153846" released by "delete_volume" :: held 1.869s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd8a5c-4a9e-4c96-827b-c87dd6fcafe7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Created reservations ['07b07cc2-5e0b-480f-9c73-5c70d9187e42', '9065d672-4a45-44e9-82a2-d90909ea4c1e', 'f54ea806-4fd9-48dc-802f-f39e5df04436', 'f074b5a1-a1e5-4de8-907b-ff8d689390d8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:32 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 Jul 03 13:08:32 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:32 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:32 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:32 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601" returned: 0 in 0.978s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:32 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb 1G Jul 03 13:08:32 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:33 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.840s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Deleted volume successfully. Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b233cb2b-3e8d-4ce2-b508-c6f2f22f93bd tempest-SnapshotDependencyTests-1775348507 None] Lock "cinder-7d4f7536-bde0-4a00-bbed-f080c5153846-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:33 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974" returned: 0 in 1.193s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-237c3105-aa77-4de4-9170-47b7060875a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b002642b-d06b-4a79-be64-c079765618bd]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:33 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 Jul 03 13:08:33 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:33 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb 1G" returned: 0 in 1.071s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a7f8d6-00e4-4a23-866c-1a591e941601 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:33 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a7f8d6-00e4-4a23-866c-1a591e941601 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb Jul 03 13:08:33 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:34 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6" returned: 0 in 0.999s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:34 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 Jul 03 13:08:34 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:34 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a7f8d6-00e4-4a23-866c-1a591e941601 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" returned: 0 in 0.892s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:34 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb is being set with open permissions: ugo+rw Jul 03 13:08:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:34 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb Jul 03 13:08:34 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:35 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:35 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974 Jul 03 13:08:35 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:35 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:35 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info Jul 03 13:08:35 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:36 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6.519b3b5b-8edd-4171-b860-593168ef2974" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-519b3b5b-8edd-4171-b860-593168ef2974" released by "_delete_snapshot" :: held 4.121s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-237c3105-aa77-4de4-9170-47b7060875a6" released by "delete_snapshot" :: held 4.162s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Created reservations ['a20d92be-f372-4436-a0bb-0f4cf8a30eea', '8aa5c580-0733-404b-b6f4-abe8ec9d4c70', '2ef318ad-de24-46fb-a8bd-1d21dba4790c', '72478ae8-501e-4689-b71b-1a150ffb632d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5962c564-1970-4a08-b25b-da2187a0dd28 tempest-ProjectMemberTests-883586709 None] Lock "cinder-519b3b5b-8edd-4171-b860-593168ef2974-delete_snapshot" released by "delete_snapshot" :: held 4.395s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:36 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:36 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info is being set with open permissions: ugo+rw Jul 03 13:08:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:36 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info Jul 03 13:08:36 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:37 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.info" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.593s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bdd2c8c4-3c6b-46d4-bd94-6b59a70437ed tempest-ProjectReaderTests-1350651292 None] Create snapshot completed successfully Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-237c3105-aa77-4de4-9170-47b7060875a6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-237c3105-aa77-4de4-9170-47b7060875a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-237c3105-aa77-4de4-9170-47b7060875a6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-237c3105-aa77-4de4-9170-47b7060875a6" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[453161c7-b84d-4ac2-a18f-9e741bb8c3f7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:37 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 Jul 03 13:08:37 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Lock "cinder-b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-79a7f8d6-00e4-4a23-866c-1a591e941601" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:38 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-79a7f8d6-00e4-4a23-866c-1a591e941601" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:38 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6 Jul 03 13:08:38 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Deleting offline snapshot b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb of volume 79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] snapshot_file for this snap is: volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546b459-53d5-4444-b363-9d8aa51b2021]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:38 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb Jul 03 13:08:38 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:39 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-237c3105-aa77-4de4-9170-47b7060875a6" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-237c3105-aa77-4de4-9170-47b7060875a6" released by "delete_volume" :: held 1.631s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Created reservations ['b227f044-469d-41a9-a3fd-8ffd1668fdf3', '205c8414-8a64-482b-8b16-b9e7113e566e', 'd2831a78-d723-49cf-96e2-6852d6d0a179', 'a9f8c393-7ed9-4b7f-9279-10d76ec7b680'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:39 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:39 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:39 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a7f8d6-00e4-4a23-866c-1a591e941601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a18bf5d-b105-466f-b884-ca46c6dd5fa8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:39 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 Jul 03 13:08:39 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:40 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.988s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac6ffb22-2756-4e60-8356-72961ac1c2f4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-237c3105-aa77-4de4-9170-47b7060875a6-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (f849acb3-2461-45fc-a321-f2b81119b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ce8fb-5c8b-4154-b4ae-6dd703e6b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:40 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ce8fb-5c8b-4154-b4ae-6dd703e6b43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013593387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893be4cd-3195-4756-970c-0d646e464267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:40Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af19f01b-7306-4228-a65f-27c23b31a9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af19f01b-7306-4228-a65f-27c23b31a9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93608276-475c-42ac-b508-42734d824b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93608276-475c-42ac-b508-42734d824b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '893be4cd-3195-4756-970c-0d646e464267', 'volume_name': 'volume-893be4cd-3195-4756-970c-0d646e464267', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95210be5-dd70-449e-99ab-bba85cf3a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95210be5-dd70-449e-99ab-bba85cf3a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630a6be-80b0-4d57-a2b1-1f4ef865526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Volume 893be4cd-3195-4756-970c-0d646e464267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-893be4cd-3195-4756-970c-0d646e464267', 'volume_size': 1} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013593387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893be4cd-3195-4756-970c-0d646e464267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:40Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Creating volume 893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:08:40 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601" returned: 0 in 1.121s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:40 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 1073741824 Jul 03 13:08:40 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:40 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb Jul 03 13:08:40 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:41 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" returned: 0 in 0.911s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:41 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb Jul 03 13:08:41 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:41 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 1073741824" returned: 0 in 1.137s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:41 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 Jul 03 13:08:41 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:42 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601.b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb" released by "_delete_snapshot" :: held 3.984s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-79a7f8d6-00e4-4a23-866c-1a591e941601" released by "delete_snapshot" :: held 4.014s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:42 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Created reservations ['218a2c5a-d244-421d-b4f3-73b0ead8a0b6', 'b2be53fb-588e-480d-9836-9ce12ec2a1c1', '2850bc57-d6b5-4da2-bf86-23147eecfe94', '4ea20819-7392-4db8-8a27-2b5c384fd29b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630a6be-80b0-4d57-a2b1-1f4ef865526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-893be4cd-3195-4756-970c-0d646e464267', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4c2cd9-b9c9-429c-91e9-ade68c7858d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Volume volume-893be4cd-3195-4756-970c-0d646e464267 (893be4cd-3195-4756-970c-0d646e464267): created successfully Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4c2cd9-b9c9-429c-91e9-ade68c7858d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (f849acb3-2461-45fc-a321-f2b81119b542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d47bc07f-9422-4d50-aadc-a8485d331ca7 tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:08:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Delete snapshot completed successfully. Jul 03 13:08:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b0f79852-a83c-40ae-bbe5-290df0c1d7ae tempest-ProjectReaderTests-1350651292 None] Lock "cinder-b8a40b0c-8ef6-4193-8edc-ee7b1c5284eb-delete_snapshot" released by "delete_snapshot" :: held 4.260s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-79a7f8d6-00e4-4a23-866c-1a591e941601-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-79a7f8d6-00e4-4a23-866c-1a591e941601-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-79a7f8d6-00e4-4a23-866c-1a591e941601" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-79a7f8d6-00e4-4a23-866c-1a591e941601" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d6318-088e-4898-b502-a4f3c7954f05]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 621ca8bd-93e7-453d-a8ba-2086f10a4d9e of volume 893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[559283ce-d6fd-44f6-b2eb-4e4bec01d2ec]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:43 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 Jul 03 13:08:43 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:43 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 Jul 03 13:08:43 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:44 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601" returned: 0 in 0.825s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:44 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601 Jul 03 13:08:44 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:44 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267" returned: 0 in 0.810s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:44 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e 1G Jul 03 13:08:44 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:45 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-79a7f8d6-00e4-4a23-866c-1a591e941601" returned: 0 in 0.693s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-79a7f8d6-00e4-4a23-866c-1a591e941601" released by "delete_volume" :: held 1.615s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Created reservations ['320fa7cb-0ce6-4105-b3c8-a0347f5275c6', '8ae396eb-22ff-4003-a1d0-723f7c3b5e73', '6ce66e29-2d1d-4ec5-968d-301514870986', 'caed21d4-b083-4798-8d21-9ef087672f72'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:45 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:45 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:45 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e 1G" returned: 0 in 0.885s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-893be4cd-3195-4756-970c-0d646e464267 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:45 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-893be4cd-3195-4756-970c-0d646e464267 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e Jul 03 13:08:45 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:46 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Deleted volume successfully. Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bbadd707-8d15-4b2a-ab89-1fd6f67fd3b6 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-79a7f8d6-00e4-4a23-866c-1a591e941601-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:46 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-893be4cd-3195-4756-970c-0d646e464267 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:46 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e is being set with open permissions: ugo+rw Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:08:46 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e Jul 03 13:08:46 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (d6b12612-9d40-4a02-b4be-f53356e7f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aae5322-0671-4e8a-9ff3-6affb8efd2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aae5322-0671-4e8a-9ff3-6affb8efd2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346994406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a7ff13-a3d6-4098-8ada-7a8e9896a627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:46Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcba0dc8-fb93-49eb-9ee1-b8579990071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcba0dc8-fb93-49eb-9ee1-b8579990071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8388263b-4b6b-4046-9897-28f22e01bb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8388263b-4b6b-4046-9897-28f22e01bb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a7ff13-a3d6-4098-8ada-7a8e9896a627', 'volume_name': 'volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba3ab97-e795-450b-83e2-6afc2ef32b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba3ab97-e795-450b-83e2-6afc2ef32b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a34e1-d9e4-4882-b6d7-56c8db03a199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Volume f4a7ff13-a3d6-4098-8ada-7a8e9896a627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627', 'volume_size': 1} Jul 03 13:08:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:47 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:47 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info Jul 03 13:08:47 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:47 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info" returned: 0 in 0.657s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info is being set with open permissions: ugo+rw Jul 03 13:08:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:47 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info Jul 03 13:08:47 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:48 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.info" returned: 0 in 0.706s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.634s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346994406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a7ff13-a3d6-4098-8ada-7a8e9896a627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:46Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Creating volume f4a7ff13-a3d6-4098-8ada-7a8e9896a627 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:08:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:48 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 1073741824 Jul 03 13:08:48 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-87b11e5d-5264-450d-868f-e5f0b73b35d9 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:08:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-621ca8bd-93e7-453d-a8ba-2086f10a4d9e-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Lock "cinder-621ca8bd-93e7-453d-a8ba-2086f10a4d9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-893be4cd-3195-4756-970c-0d646e464267" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-893be4cd-3195-4756-970c-0d646e464267" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-621ca8bd-93e7-453d-a8ba-2086f10a4d9e" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-621ca8bd-93e7-453d-a8ba-2086f10a4d9e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 621ca8bd-93e7-453d-a8ba-2086f10a4d9e of volume 893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0ca86-92f9-411e-99df-b816c54589bf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:49 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e Jul 03 13:08:49 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:49 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 1073741824" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:49 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 Jul 03 13:08:49 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:49 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-893be4cd-3195-4756-970c-0d646e464267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ffa580-a820-4243-b391-910c569252db]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:50 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:50 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 Jul 03 13:08:50 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a34e1-d9e4-4882-b6d7-56c8db03a199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a193b51f-8463-4860-ab1a-ceb1cfb393d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Volume volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 (f4a7ff13-a3d6-4098-8ada-7a8e9896a627): created successfully Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a193b51f-8463-4860-ab1a-ceb1cfb393d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (d6b12612-9d40-4a02-b4be-f53356e7f50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e8daba14-d10b-47a6-813e-9e88180167b5 tempest-ProjectReaderTests-1350651292 None] Created volume successfully. Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Creating offline snapshot 66e34b40-51ed-4299-aa98-38d9a19fb836 of volume f4a7ff13-a3d6-4098-8ada-7a8e9896a627 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc9aef0-effd-4ee4-a338-018de8fadc2b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:50 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:50 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e Jul 03 13:08:50 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:50 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 Jul 03 13:08:50 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:51 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:51 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e" returned: 0 in 0.879s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:51 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 1G Jul 03 13:08:51 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:51 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e Jul 03 13:08:51 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:52 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267.621ca8bd-93e7-453d-a8ba-2086f10a4d9e" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-621ca8bd-93e7-453d-a8ba-2086f10a4d9e" released by "_delete_snapshot" :: held 3.425s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-893be4cd-3195-4756-970c-0d646e464267" released by "delete_snapshot" :: held 3.452s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Created reservations ['07f57c82-4c21-4633-b08a-bb2826dcd5e0', '661cfbaf-5982-440b-a45b-9b6898d3a8f5', '20a20b1f-1274-4ed6-8144-a2d60565640b', '6f7e5b8f-73b8-4d1e-ac16-ac08b06daaa2'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:52 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 1G" returned: 0 in 0.887s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cee8ccfb-5da9-4905-89ac-373a5374bcd5 tempest-ProjectMemberTests-883586709 None] Lock "cinder-621ca8bd-93e7-453d-a8ba-2086f10a4d9e-delete_snapshot" released by "delete_snapshot" :: held 3.613s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:52 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 Jul 03 13:08:52 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-893be4cd-3195-4756-970c-0d646e464267-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Lock "cinder-893be4cd-3195-4756-970c-0d646e464267-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:53 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836" returned: 0 in 0.741s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:53 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 is being set with open permissions: ugo+rw Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-893be4cd-3195-4756-970c-0d646e464267" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:53 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836 Jul 03 13:08:53 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-893be4cd-3195-4756-970c-0d646e464267" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc4ed5-e935-4dd6-8918-808fd0ae3352]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:53 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 Jul 03 13:08:53 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:54 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.66e34b40-51ed-4299-aa98-38d9a19fb836" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:54 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info Jul 03 13:08:54 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:54 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267" returned: 0 in 0.847s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:54 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267 Jul 03 13:08:54 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:54 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info" returned: 0 in 0.675s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info is being set with open permissions: ugo+rw Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:54 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info Jul 03 13:08:54 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:54 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-893be4cd-3195-4756-970c-0d646e464267" returned: 0 in 0.692s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-893be4cd-3195-4756-970c-0d646e464267" released by "delete_volume" :: held 1.607s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Created reservations ['de0cb0dd-6ea5-45aa-9888-8408ab6b09be', 'cbf1c063-5614-4073-8a06-576fbd59e474', '36093574-92bb-4c42-af88-2e574c6de898', '491eac8b-d1dc-4ab0-8d7f-2373f3ca7c2b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:55 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:08:55 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:55 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f4a7ff13-a3d6-4098-8ada-7a8e9896a627.info" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.634s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9a091575-18ac-45cd-a752-774c53de04fe tempest-ProjectReaderTests-1350651292 None] Create snapshot completed successfully Jul 03 13:08:55 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:08:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:08:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3968dd3a-05cb-4264-b3f3-da1c2a667d36 tempest-ProjectMemberTests-883586709 None] Lock "cinder-893be4cd-3195-4756-970c-0d646e464267-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-23da8869-cd38-42ce-8df1-cacbd1bed8b6 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-66e34b40-51ed-4299-aa98-38d9a19fb836-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-23da8869-cd38-42ce-8df1-cacbd1bed8b6 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-66e34b40-51ed-4299-aa98-38d9a19fb836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:08:56 devstack cinder-volume[86966]: INFO cinder.message.api [None req-23da8869-cd38-42ce-8df1-cacbd1bed8b6 tempest-ProjectReaderTests-1350651292 None] Creating message record for request_id = req-23da8869-cd38-42ce-8df1-cacbd1bed8b6 Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (d9b80813-0283-4e2c-a59d-1e02c6b6793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9830d0bc-a022-4d11-81b1-29b1e48df47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-23da8869-cd38-42ce-8df1-cacbd1bed8b6 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-66e34b40-51ed-4299-aa98-38d9a19fb836-delete_snapshot" released by "delete_snapshot" :: held 0.086s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server [None req-23da8869-cd38-42ce-8df1-cacbd1bed8b6 tempest-ProjectReaderTests-1350651292 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 13:08:56 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9830d0bc-a022-4d11-81b1-29b1e48df47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855602804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaf21bf-966f-4ecc-aeb2-c7c216ee8710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:56Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae714119-1a63-469a-be26-72b3b133db91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae714119-1a63-469a-be26-72b3b133db91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeff339-f46c-4933-83f7-fb1ab78edaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeff339-f46c-4933-83f7-fb1ab78edaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeaf21bf-966f-4ecc-aeb2-c7c216ee8710', 'volume_name': 'volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02ea89c-0510-4c20-a31b-44a7e6499c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02ea89c-0510-4c20-a31b-44a7e6499c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f5f02e-b0ef-4cde-946f-3d92d5f7cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Volume eeaf21bf-966f-4ecc-aeb2-c7c216ee8710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710', 'volume_size': 1} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855602804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaf21bf-966f-4ecc-aeb2-c7c216ee8710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:56Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Creating volume eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:08:56 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:08:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:56 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 1073741824 Jul 03 13:08:56 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:57 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 1073741824" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:57 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 Jul 03 13:08:57 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:57 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f5f02e-b0ef-4cde-946f-3d92d5f7cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86105c27-ae67-4c90-ad80-3d5998c1a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:08:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Volume volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 (eeaf21bf-966f-4ecc-aeb2-c7c216ee8710): created successfully Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86105c27-ae67-4c90-ad80-3d5998c1a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:08:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (d9b80813-0283-4e2c-a59d-1e02c6b6793e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:08:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3a5d6e5d-fc4e-43a0-bb10-3e641c60e8e2 tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:08:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:08:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:08:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 1cffa595-158b-4a22-82b8-fe43e6001bcc of volume eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:08:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[843be242-44e5-49d3-a17d-9bcb6afcb9fe]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:08:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:58 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 Jul 03 13:08:58 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:08:59 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 03 13:08:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:08:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:08:59 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc 1G Jul 03 13:08:59 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:00 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc 1G" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:00 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc Jul 03 13:09:00 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:00 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:00 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc is being set with open permissions: ugo+rw Jul 03 13:09:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:00 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc Jul 03 13:09:00 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:01 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc" returned: 0 in 0.640s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:01 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info Jul 03 13:09:01 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:02 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:09:02 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:02 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:02 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info is being set with open permissions: ugo+rw Jul 03 13:09:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:02 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info Jul 03 13:09:02 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:02 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:09:02 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.info" returned: 0 in 0.701s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.463s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-48017b3b-d4be-4f4b-9278-91a6e7b3c8b3 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-1cffa595-158b-4a22-82b8-fe43e6001bcc-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Lock "cinder-1cffa595-158b-4a22-82b8-fe43e6001bcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-1cffa595-158b-4a22-82b8-fe43e6001bcc" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-1cffa595-158b-4a22-82b8-fe43e6001bcc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 1cffa595-158b-4a22-82b8-fe43e6001bcc of volume eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2f997-2993-4daf-a477-51c6aee27c97]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:03 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc Jul 03 13:09:03 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:04 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:09:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c234ab1-da8c-426d-b437-9bc2e2160def]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:04 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 Jul 03 13:09:04 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:05 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:05 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc Jul 03 13:09:05 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:06 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc" returned: 0 in 0.767s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:06 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc Jul 03 13:09:06 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:06 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710.1cffa595-158b-4a22-82b8-fe43e6001bcc" returned: 0 in 0.679s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-1cffa595-158b-4a22-82b8-fe43e6001bcc" released by "_delete_snapshot" :: held 3.155s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" released by "delete_snapshot" :: held 3.179s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:INSERT=32,cinder:UPDATE=110,cinder:SELECT=92,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Created reservations ['ff0ec205-42e1-4c71-807e-1c7bebcd74ed', 'be46f98a-9921-484b-a9f5-f43dde6aaebc', 'a39b36ec-e714-4008-9bb1-ea9b6605c208', '794f2a5d-4c67-4a9e-a290-210b2657a658'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:09:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:09:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd29d6fe-a6a1-4285-b233-a1eb9bcdb504 tempest-ProjectMemberTests-883586709 None] Lock "cinder-1cffa595-158b-4a22-82b8-fe43e6001bcc-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Lock "cinder-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=106,cinder:SELECT=85,cinder:DELETE=11,cinder:INSERT=29 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b8de55-a12e-48e9-af39-ff14b1d66372]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:08 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 Jul 03 13:09:08 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:08 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:08 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710 Jul 03 13:09:08 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:09 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" returned: 0 in 0.658s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710" released by "delete_volume" :: held 1.519s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Created reservations ['9aeef240-0617-499f-8486-0671f9ec6450', '250fd625-3225-440e-abe4-97efcb6203b7', '0eaf2f64-528b-43db-91eb-42e8d7129690', '34312d9f-84ca-405a-b49e-60bcaa404554'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:09 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:09:09 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:10 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:09:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1bcee56d-bd46-4ff1-9327-3f78fd249f68 tempest-ProjectMemberTests-883586709 None] Lock "cinder-eeaf21bf-966f-4ecc-aeb2-c7c216ee8710-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (62d91d98-4cfa-4958-bcb0-a514d119e967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895dffe-4de8-4104-8b8b-d739304722bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895dffe-4de8-4104-8b8b-d739304722bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217537374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b3e338-7f24-4e6b-befc-24b6b246ed03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:11Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67de668-21ce-42cb-b27c-8e90e459c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67de668-21ce-42cb-b27c-8e90e459c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c179005-f1aa-489e-afa2-626668830959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c179005-f1aa-489e-afa2-626668830959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b3e338-7f24-4e6b-befc-24b6b246ed03', 'volume_name': 'volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8105c982-17a2-45c3-8164-a749f0545fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8105c982-17a2-45c3-8164-a749f0545fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cf306d-84cb-45f6-87cf-05af0a740b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Volume f7b3e338-7f24-4e6b-befc-24b6b246ed03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03', 'volume_size': 1} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217537374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b3e338-7f24-4e6b-befc-24b6b246ed03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:11Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Creating volume f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:09:10 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:09:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:10 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 1073741824 Jul 03 13:09:10 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:11 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 1073741824" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:11 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 Jul 03 13:09:11 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:12 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03" returned: 0 in 0.670s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cf306d-84cb-45f6-87cf-05af0a740b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfec24d3-e002-4b5c-82e5-b4934d226e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Volume volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 (f7b3e338-7f24-4e6b-befc-24b6b246ed03): created successfully Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfec24d3-e002-4b5c-82e5-b4934d226e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (62d91d98-4cfa-4958-bcb0-a514d119e967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:09:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f065bc71-a7ba-4816-8485-6d978e3fcf2a tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Creating offline snapshot c1c7b99f-ed6b-45ed-b80d-d9796cf6670c of volume f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a0986d-7822-4afa-a711-61f11850d1a0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:12 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 Jul 03 13:09:12 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:13 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:13 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c 1G Jul 03 13:09:13 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:14 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c 1G" returned: 0 in 0.846s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:14 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c Jul 03 13:09:14 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:15 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" returned: 0 in 0.686s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:15 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c is being set with open permissions: ugo+rw Jul 03 13:09:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:15 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c Jul 03 13:09:15 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:15 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" returned: 0 in 0.636s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:15 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info Jul 03 13:09:15 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:16 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:16 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info is being set with open permissions: ugo+rw Jul 03 13:09:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:16 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info Jul 03 13:09:16 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:17 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.info" returned: 0 in 0.674s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.521s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4f536ecd-c5f2-4c9f-b76c-c012e4aa73de tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-c1c7b99f-ed6b-45ed-b80d-d9796cf6670c-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Lock "cinder-c1c7b99f-ed6b-45ed-b80d-d9796cf6670c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-f7b3e338-7f24-4e6b-befc-24b6b246ed03" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f7b3e338-7f24-4e6b-befc-24b6b246ed03" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot c1c7b99f-ed6b-45ed-b80d-d9796cf6670c of volume f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c8c031-1ce7-4ff4-8414-da7f124ddcf0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:18 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c Jul 03 13:09:18 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:18 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c084a-e65d-4e05-927b-b446e3b0085f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:19 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 Jul 03 13:09:19 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:19 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:19 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c Jul 03 13:09:19 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:20 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:20 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c Jul 03 13:09:20 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:21 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03.c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" returned: 0 in 0.720s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-c1c7b99f-ed6b-45ed-b80d-d9796cf6670c" released by "_delete_snapshot" :: held 3.129s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f7b3e338-7f24-4e6b-befc-24b6b246ed03" released by "delete_snapshot" :: held 3.154s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:21 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Created reservations ['37abeb35-f5de-4a22-a274-517db482b661', '75757e17-4640-44d6-bbb7-7a391848142e', 'b8c8b622-f641-4170-a158-08e65408acbd', 'ab1c8f5e-fb5e-495d-958c-361a9b0d7971'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:09:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:09:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-38aa6104-92fc-45ee-81e9-dfcbdbe8a043 tempest-ProjectMemberTests-883586709 None] Lock "cinder-c1c7b99f-ed6b-45ed-b80d-d9796cf6670c-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-f7b3e338-7f24-4e6b-befc-24b6b246ed03-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Lock "cinder-f7b3e338-7f24-4e6b-befc-24b6b246ed03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-f7b3e338-7f24-4e6b-befc-24b6b246ed03" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f7b3e338-7f24-4e6b-befc-24b6b246ed03" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03ab78-3663-4c8c-ac92-77c62960f030]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:22 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 Jul 03 13:09:22 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:23 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:23 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03 Jul 03 13:09:23 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:24 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f7b3e338-7f24-4e6b-befc-24b6b246ed03" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f7b3e338-7f24-4e6b-befc-24b6b246ed03" released by "delete_volume" :: held 1.636s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Created reservations ['7a3b8cf4-f452-41aa-a1a0-a526e8c74e82', '54af6d20-965c-4453-8534-c284de76aea2', '6d5860f2-16f8-425c-9367-1c8f6e364fe5', '82a38612-57b8-4878-a651-65048dc2c803'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:24 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:09:24 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:24 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:09:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:09:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-841e0471-08d1-44d9-a083-6e50e57bdd81 tempest-ProjectMemberTests-883586709 None] Lock "cinder-f7b3e338-7f24-4e6b-befc-24b6b246ed03-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (42835201-da41-451b-8e86-eaca9369ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e689e619-e4f5-4fa8-9815-9472bdc99f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e689e619-e4f5-4fa8-9815-9472bdc99f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122248025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:25Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07148ce-cbc2-44b8-8a91-0c9cea4dc211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07148ce-cbc2-44b8-8a91-0c9cea4dc211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ff8781-6823-4e1b-b9ea-2ccc78ccba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ff8781-6823-4e1b-b9ea-2ccc78ccba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee', 'volume_name': 'volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757dd287-dcb1-4ba2-8086-52f4e8f8033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757dd287-dcb1-4ba2-8086-52f4e8f8033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99718e3e-6bd6-4583-b01c-37878d1b2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Volume 3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee', 'volume_size': 1} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122248025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:25Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Creating volume 3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:09:25 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:09:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:25 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee 1073741824 Jul 03 13:09:25 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:26 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee 1073741824" returned: 0 in 0.882s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:26 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee Jul 03 13:09:26 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:26 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee" returned: 0 in 0.719s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99718e3e-6bd6-4583-b01c-37878d1b2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617303c9-9262-407a-993d-b95bedef3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:09:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Volume volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee (3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee): created successfully Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617303c9-9262-407a-993d-b95bedef3604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:09:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (42835201-da41-451b-8e86-eaca9369ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:09:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b372d6ee-28e6-4042-897c-41eaa4ffc09a tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:09:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:09:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:09:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 967053b5-e376-4074-8f8f-1d5b7b87b862 of volume 3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:09:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba2ccd0-69b4-4be9-b9b9-b77b427a70b7]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:09:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:27 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee Jul 03 13:09:27 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:28 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:28 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 1G Jul 03 13:09:28 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:29 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 1G" returned: 0 in 0.938s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:29 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 Jul 03 13:09:29 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:29 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862" returned: 0 in 0.778s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:29 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 is being set with open permissions: ugo+rw Jul 03 13:09:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:29 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862 Jul 03 13:09:29 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:30 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.967053b5-e376-4074-8f8f-1d5b7b87b862" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:30 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info Jul 03 13:09:30 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:31 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:31 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info is being set with open permissions: ugo+rw Jul 03 13:09:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:09:31 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info Jul 03 13:09:31 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:09:32 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 03 13:09:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3ff2e376-471b-4a86-b6c5-f9fc6c9a98ee.info" returned: 0 in 0.703s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:09:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.862s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:09:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1a0b428a-d073-49e2-8339-41182fa64fc6 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:09:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41770d87-7c5c-4721-9176-a48cf7d59ab9 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-967053b5-e376-4074-8f8f-1d5b7b87b862-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:09:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41770d87-7c5c-4721-9176-a48cf7d59ab9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-967053b5-e376-4074-8f8f-1d5b7b87b862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:09:32 devstack cinder-volume[86966]: INFO cinder.message.api [None req-41770d87-7c5c-4721-9176-a48cf7d59ab9 tempest-ProjectMemberTests-883586709 None] Creating message record for request_id = req-41770d87-7c5c-4721-9176-a48cf7d59ab9 Jul 03 13:09:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41770d87-7c5c-4721-9176-a48cf7d59ab9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-967053b5-e376-4074-8f8f-1d5b7b87b862-delete_snapshot" released by "delete_snapshot" :: held 0.046s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server [None req-41770d87-7c5c-4721-9176-a48cf7d59ab9 tempest-ProjectMemberTests-883586709 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 13:09:32 devstack cinder-volume[86966]: ERROR oslo_messaging.rpc.server Jul 03 13:09:42 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:09:42 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=44,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:10:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:10:02 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:10:02 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:10:02 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jul 03 13:10:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.733s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:10:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:11:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:11:02 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:11:02 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:11:02 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Jul 03 13:11:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.737s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:11:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:11:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:11:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:02 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:12:02 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:02 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.700s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (3772aeb8-5e8f-4cbb-b11e-ffe915ed4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6bdfc5-4215-4886-8d14-d37ffe76ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6bdfc5-4215-4886-8d14-d37ffe76ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715038346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752d8ffd-ba08-4e24-b4d3-852b3b2857dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:13Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fbd4da-e2f4-448b-a7d3-8c7634230be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fbd4da-e2f4-448b-a7d3-8c7634230be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2a0599-c06f-490b-bc38-92d307a004ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2a0599-c06f-490b-bc38-92d307a004ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752d8ffd-ba08-4e24-b4d3-852b3b2857dc', 'volume_name': 'volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5b5d77-b150-4317-ad47-86e9ab889cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5b5d77-b150-4317-ad47-86e9ab889cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822f70d0-1223-4f7a-8a8e-1c2035edde77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Volume 752d8ffd-ba08-4e24-b4d3-852b3b2857dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc', 'volume_size': 1} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715038346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752d8ffd-ba08-4e24-b4d3-852b3b2857dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:13Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Creating volume 752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:12:13 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:12:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:13 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc 1073741824 Jul 03 13:12:13 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:14 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc 1073741824" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:14 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc Jul 03 13:12:14 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:14 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" returned: 0 in 0.660s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822f70d0-1223-4f7a-8a8e-1c2035edde77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad5a14c-cab7-4bc7-af51-f41ffde7406f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Volume volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc (752d8ffd-ba08-4e24-b4d3-852b3b2857dc): created successfully Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad5a14c-cab7-4bc7-af51-f41ffde7406f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (3772aeb8-5e8f-4cbb-b11e-ffe915ed4213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fcb44c09-aeed-4781-8997-b380217ac9d6 tempest-ProjectReaderTests-1350651292 None] Created volume successfully. Jul 03 13:12:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Creating offline snapshot 1347331e-0825-496d-9e25-079b7bc44437 of volume 752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:12:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[483944af-7c74-4c67-9740-6c2a52ec1f9f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:15 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc Jul 03 13:12:15 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:16 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:16 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 1G Jul 03 13:12:16 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:16 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 1G" returned: 0 in 0.810s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:17 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 Jul 03 13:12:17 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:17 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:17 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 is being set with open permissions: ugo+rw Jul 03 13:12:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:17 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 Jul 03 13:12:17 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:18 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:18 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info Jul 03 13:12:18 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:19 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:19 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info is being set with open permissions: ugo+rw Jul 03 13:12:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:19 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info Jul 03 13:12:19 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:19 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.info" returned: 0 in 0.698s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ac6d4d4-0a62-48cb-adac-15e47959927d tempest-ProjectReaderTests-1350651292 None] Create snapshot completed successfully Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-1347331e-0825-496d-9e25-079b7bc44437-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-1347331e-0825-496d-9e25-079b7bc44437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-1347331e-0825-496d-9e25-079b7bc44437" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-1347331e-0825-496d-9e25-079b7bc44437" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Deleting offline snapshot 1347331e-0825-496d-9e25-079b7bc44437 of volume 752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] snapshot_file for this snap is: volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02fbc5e-f933-4477-ab6f-81edf2c8d5e8]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:20 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 Jul 03 13:12:20 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:21 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:12:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd583e4-2636-46bb-ad04-fd6cbf96cd72]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:21 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc Jul 03 13:12:21 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:22 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:22 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 Jul 03 13:12:22 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:23 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:23 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437 Jul 03 13:12:23 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:23 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc.1347331e-0825-496d-9e25-079b7bc44437" returned: 0 in 0.657s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-1347331e-0825-496d-9e25-079b7bc44437" released by "_delete_snapshot" :: held 3.071s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" released by "delete_snapshot" :: held 3.099s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Created reservations ['1547a184-cc30-41be-b942-52cbdc02fc1c', '2b9ca418-a0ce-46ee-a091-1d3235a2fde3', '09d954bc-40f2-4fc8-a454-fd2b6e645c18', '9ad244f6-d13a-43fe-8a9c-47cbee37f22c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:12:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Delete snapshot completed successfully. Jul 03 13:12:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3dd4f5f3-14e8-4e36-ba96-4cdd49328908 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-1347331e-0825-496d-9e25-079b7bc44437-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-752d8ffd-ba08-4e24-b4d3-852b3b2857dc-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-752d8ffd-ba08-4e24-b4d3-852b3b2857dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b059f8ba-dfe2-431e-ac79-0b08b766b73b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:25 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc Jul 03 13:12:25 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:25 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:25 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc Jul 03 13:12:25 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:26 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" returned: 0 in 0.636s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-752d8ffd-ba08-4e24-b4d3-852b3b2857dc" released by "delete_volume" :: held 1.452s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Created reservations ['e7565460-8906-48e1-88db-dd7e23e952f5', '4d551963-439c-47c5-9307-83372c4280ed', '94ce327d-6d85-42b2-87fa-066ebafca653', 'e53ec283-e6c8-4f73-8af8-ce130fc06c82'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:26 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:12:26 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:27 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:12:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Deleted volume successfully. Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fc92e259-9da5-4876-b59f-5bdfd3624f82 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-752d8ffd-ba08-4e24-b4d3-852b3b2857dc-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (07abc80a-c130-4128-a322-35f7c6b24dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54044e68-3ab6-49da-873d-e8045ff061b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54044e68-3ab6-49da-873d-e8045ff061b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105124082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116c2d86-139a-41cc-a370-d2ffdb7e40fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:28Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721fc910-5d81-4959-b7f7-7ad339b32dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721fc910-5d81-4959-b7f7-7ad339b32dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b85e96-3519-478d-b90a-4c1963ee7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b85e96-3519-478d-b90a-4c1963ee7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116c2d86-139a-41cc-a370-d2ffdb7e40fd', 'volume_name': 'volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cbfa84-265e-4615-9b0a-d28f323872c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cbfa84-265e-4615-9b0a-d28f323872c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f2e0b3-b43e-49af-9235-8050ea17f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Volume 116c2d86-139a-41cc-a370-d2ffdb7e40fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd', 'volume_size': 1} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105124082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116c2d86-139a-41cc-a370-d2ffdb7e40fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:28Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Creating volume 116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:12:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:12:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:27 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd 1073741824 Jul 03 13:12:27 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:28 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd 1073741824" returned: 0 in 0.851s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:28 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd Jul 03 13:12:28 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:29 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd" returned: 0 in 0.670s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f2e0b3-b43e-49af-9235-8050ea17f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbd7f0b-2693-4ed6-8e8a-e69ca966d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Volume volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd (116c2d86-139a-41cc-a370-d2ffdb7e40fd): created successfully Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbd7f0b-2693-4ed6-8e8a-e69ca966d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (07abc80a-c130-4128-a322-35f7c6b24dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ba09fcb7-1deb-4ebd-bb1a-af0cb5e509ed tempest-ProjectReaderTests-1350651292 None] Created volume successfully. Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Creating offline snapshot 4e47cef9-93f7-4e22-9bb4-2212f5b450af of volume 116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f47135-32be-4636-8825-9d1b29962b05]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:30 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd Jul 03 13:12:30 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:30 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:30 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af 1G Jul 03 13:12:30 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:31 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af 1G" returned: 0 in 0.846s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:31 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af Jul 03 13:12:31 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:32 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:32 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af is being set with open permissions: ugo+rw Jul 03 13:12:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:32 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af Jul 03 13:12:32 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:32 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af" returned: 0 in 0.660s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:32 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info Jul 03 13:12:32 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:33 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info" returned: 0 in 0.697s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:33 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info is being set with open permissions: ugo+rw Jul 03 13:12:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:33 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info Jul 03 13:12:33 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:34 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.info" returned: 0 in 0.640s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.440s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-51e31062-edb7-4545-bbd1-9ae127863bc2 tempest-ProjectReaderTests-1350651292 None] Create snapshot completed successfully Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-4e47cef9-93f7-4e22-9bb4-2212f5b450af-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-4e47cef9-93f7-4e22-9bb4-2212f5b450af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-116c2d86-139a-41cc-a370-d2ffdb7e40fd" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-116c2d86-139a-41cc-a370-d2ffdb7e40fd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-4e47cef9-93f7-4e22-9bb4-2212f5b450af" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-4e47cef9-93f7-4e22-9bb4-2212f5b450af" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Deleting offline snapshot 4e47cef9-93f7-4e22-9bb4-2212f5b450af of volume 116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] snapshot_file for this snap is: volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e6db9-40c1-4579-95b9-897f0c1146b9]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:35 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af Jul 03 13:12:35 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:35 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa7cf3f-4c00-43b7-ac28-5607e22eeed4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:36 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd Jul 03 13:12:36 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:36 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd" returned: 0 in 0.766s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:36 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af Jul 03 13:12:36 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:37 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:37 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af Jul 03 13:12:37 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:38 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd.4e47cef9-93f7-4e22-9bb4-2212f5b450af" returned: 0 in 0.660s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-4e47cef9-93f7-4e22-9bb4-2212f5b450af" released by "_delete_snapshot" :: held 3.081s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-116c2d86-139a-41cc-a370-d2ffdb7e40fd" released by "delete_snapshot" :: held 3.102s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Created reservations ['75153494-5d75-445a-a59a-bef1252cb2b8', '37c5b8be-2afb-4695-a272-9c4b671158e0', 'e6f5b701-f19d-4a28-bef3-9a5a5801b241', '10b31bc0-a5ab-4d32-a779-9984b7c5c30a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:12:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Delete snapshot completed successfully. Jul 03 13:12:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57add11b-9160-4aa4-8773-5a09cbb8cf89 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-4e47cef9-93f7-4e22-9bb4-2212f5b450af-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-116c2d86-139a-41cc-a370-d2ffdb7e40fd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-116c2d86-139a-41cc-a370-d2ffdb7e40fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-116c2d86-139a-41cc-a370-d2ffdb7e40fd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-116c2d86-139a-41cc-a370-d2ffdb7e40fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[55093e3c-d3fb-4955-af80-cf1562f00df6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:39 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd Jul 03 13:12:39 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:40 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:40 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd Jul 03 13:12:40 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:40 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-116c2d86-139a-41cc-a370-d2ffdb7e40fd" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-116c2d86-139a-41cc-a370-d2ffdb7e40fd" released by "delete_volume" :: held 1.485s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Created reservations ['abb8f47f-8279-40c6-9cf0-7be7d39ad213', '96e00f60-d834-44f9-a8ac-1e5124b4fb00', 'd3cb7f5c-5178-490c-87e3-007d617e222c', '0bb748a5-24fa-4547-84c1-9b361376f657'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:41 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:12:41 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:41 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.656s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:41 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:12:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Deleted volume successfully. Jul 03 13:12:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6d8f834c-f595-42b3-9c98-34df577834c3 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-116c2d86-139a-41cc-a370-d2ffdb7e40fd-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (865afdd1-4ca6-48fb-afda-f866801916bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918c629a-7b6f-4cd4-9701-e5465da64494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918c629a-7b6f-4cd4-9701-e5465da64494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536523049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b64ed3d-5676-49f5-9f06-029e83fe7bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:42Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7de02f-9d6f-433b-9657-0d8f159dd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7de02f-9d6f-433b-9657-0d8f159dd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202bf790-9859-42d8-a616-f8079e281213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202bf790-9859-42d8-a616-f8079e281213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b64ed3d-5676-49f5-9f06-029e83fe7bcb', 'volume_name': 'volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bea3b9-cb8d-40ac-87b9-f8e664656e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bea3b9-cb8d-40ac-87b9-f8e664656e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e510a59a-1b46-4a74-9bb4-2c031822e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Volume 3b64ed3d-5676-49f5-9f06-029e83fe7bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb', 'volume_size': 1} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536523049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b64ed3d-5676-49f5-9f06-029e83fe7bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f6b74f49254a5a919d9bc3ff37e3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:42Z,use_quota=True,user_id='30bb163241f44935b784d214921a997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Creating volume 3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:12:42 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:42 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb 1073741824 Jul 03 13:12:42 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:42 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb 1073741824" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:43 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb Jul 03 13:12:43 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:43 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" returned: 0 in 0.708s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e510a59a-1b46-4a74-9bb4-2c031822e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd81b2d-9f33-43c7-b98f-515b0a31a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Volume volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb (3b64ed3d-5676-49f5-9f06-029e83fe7bcb): created successfully Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd81b2d-9f33-43c7-b98f-515b0a31a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Flow 'volume_create_manager' (865afdd1-4ca6-48fb-afda-f866801916bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-10a441e3-a4db-48e7-b7e3-a09b12b1a53b tempest-ProjectReaderTests-1350651292 None] Created volume successfully. Jul 03 13:12:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Creating offline snapshot 8a90a507-42bc-4272-914e-fb9103a9c518 of volume 3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:12:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc34db-e9b2-4976-a96b-30fc398adae4]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:44 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb Jul 03 13:12:44 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:45 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:45 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 1G Jul 03 13:12:45 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:45 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 1G" returned: 0 in 0.767s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:45 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 Jul 03 13:12:45 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:46 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518" returned: 0 in 0.663s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:46 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 is being set with open permissions: ugo+rw Jul 03 13:12:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:46 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 Jul 03 13:12:46 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:47 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518" returned: 0 in 0.640s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:47 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info Jul 03 13:12:47 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:47 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info" returned: 0 in 0.634s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info is being set with open permissions: ugo+rw Jul 03 13:12:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:47 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info Jul 03 13:12:47 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:48 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.info" returned: 0 in 0.617s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.167s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8a14c57f-91b6-483f-a6ee-fd905a8c2732 tempest-ProjectReaderTests-1350651292 None] Create snapshot completed successfully Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-8a90a507-42bc-4272-914e-fb9103a9c518-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Lock "cinder-8a90a507-42bc-4272-914e-fb9103a9c518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (daa305fb-a17d-4740-b068-eb5b67e0d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b27da1-e66f-46c9-bd2e-bada3575591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-8a90a507-42bc-4272-914e-fb9103a9c518" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b27da1-e66f-46c9-bd2e-bada3575591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281096258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b4c4e3-04be-4f4a-9349-051c2388bed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:49Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07afddbe-0bef-4582-beb7-f2e173d8814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07afddbe-0bef-4582-beb7-f2e173d8814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7aa852d-777a-4bc9-87f8-692a52f8625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7aa852d-777a-4bc9-87f8-692a52f8625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b4c4e3-04be-4f4a-9349-051c2388bed3', 'volume_name': 'volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1b8310-1311-4a30-b044-d800776bc062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1b8310-1311-4a30-b044-d800776bc062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3792a677-cee9-4954-90df-854a543e1893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Volume e9b4c4e3-04be-4f4a-9349-051c2388bed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3', 'volume_size': 1} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281096258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b4c4e3-04be-4f4a-9349-051c2388bed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:49Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Creating volume e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:12:49 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-8a90a507-42bc-4272-914e-fb9103a9c518" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Deleting offline snapshot 8a90a507-42bc-4272-914e-fb9103a9c518 of volume 3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:12:49 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 1073741824 Jul 03 13:12:49 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] snapshot_file for this snap is: volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b277e59e-d2a0-426c-a938-e60820fc3d18]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:49 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 Jul 03 13:12:49 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:50 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:12:50 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 1073741824" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4290b-6594-4e8c-80a3-3134e883bcb6]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:50 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 Jul 03 13:12:50 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:50 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb Jul 03 13:12:50 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:51 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3792a677-cee9-4954-90df-854a543e1893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bf2d7d-47c2-4d3a-88de-b51d881e24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:12:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Volume volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 (e9b4c4e3-04be-4f4a-9349-051c2388bed3): created successfully Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bf2d7d-47c2-4d3a-88de-b51d881e24c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (daa305fb-a17d-4740-b068-eb5b67e0d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:12:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9495c277-0adf-41e7-87f5-154b1b113fac tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:12:51 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" returned: 0 in 0.813s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:51 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 Jul 03 13:12:51 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 093ff62b-1464-4343-8504-90c9bf2f3408 of volume e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df17ad-3aa8-4232-a956-0b6bcefd2efa]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:51 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 Jul 03 13:12:51 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:52 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:52 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518 Jul 03 13:12:52 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:52 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3" returned: 0 in 0.761s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:52 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 1G Jul 03 13:12:52 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:52 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb.8a90a507-42bc-4272-914e-fb9103a9c518" returned: 0 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-8a90a507-42bc-4272-914e-fb9103a9c518" released by "_delete_snapshot" :: held 3.280s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" released by "delete_snapshot" :: held 3.375s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Created reservations ['3eaf74d6-e975-4d0b-93fe-d686f4dcb5e7', '78d53a46-02cb-43ae-93dc-7230250a5dc6', '748ed01d-cc96-4ea8-8ea9-3e2d00e94901', 'a8d53449-16a5-4cbc-bd29-a902644351f8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:12:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Delete snapshot completed successfully. Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bea33d6a-69f7-4a6c-a3ec-a06e1b2b1cac tempest-ProjectReaderTests-1350651292 None] Lock "cinder-8a90a507-42bc-4272-914e-fb9103a9c518-delete_snapshot" released by "delete_snapshot" :: held 3.579s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:53 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 1G" returned: 0 in 0.850s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:53 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 Jul 03 13:12:53 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-3b64ed3d-5676-49f5-9f06-029e83fe7bcb-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-3b64ed3d-5676-49f5-9f06-029e83fe7bcb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "cinder-quobyte-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6fb26a-d798-472b-93dc-6b77097a4394]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:53 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb Jul 03 13:12:53 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:54 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 is being set with open permissions: ugo+rw Jul 03 13:12:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:54 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 Jul 03 13:12:54 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:54 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:54 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb Jul 03 13:12:54 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:54 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408" returned: 0 in 0.662s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:54 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info Jul 03 13:12:54 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:55 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-quobyte-3b64ed3d-5676-49f5-9f06-029e83fe7bcb" released by "delete_volume" :: held 1.510s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Created reservations ['ddc468a3-c66d-4d08-b169-bed25a626323', '8c1535a5-7d7b-470b-ba85-b4ccc5dada54', '48d03613-48af-4977-9c29-79302ca23f42', '6ad32dfb-0d94-4a64-9ad2-741e6e4b12fd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:55 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:55 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:12:55 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info" returned: 0 in 0.665s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:55 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info is being set with open permissions: ugo+rw Jul 03 13:12:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:55 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info Jul 03 13:12:55 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:56 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.670s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:56 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:12:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Deleted volume successfully. Jul 03 13:12:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f4524ac1-00a2-4010-a77b-817f4902abb8 tempest-ProjectReaderTests-1350651292 None] Lock "cinder-3b64ed3d-5676-49f5-9f06-029e83fe7bcb-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:12:56 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.info" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.488s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:12:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8397588e-ea06-41ca-9cd3-9dca689f66f3 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-093ff62b-1464-4343-8504-90c9bf2f3408-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Lock "cinder-093ff62b-1464-4343-8504-90c9bf2f3408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-e9b4c4e3-04be-4f4a-9349-051c2388bed3" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-e9b4c4e3-04be-4f4a-9349-051c2388bed3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-093ff62b-1464-4343-8504-90c9bf2f3408" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-093ff62b-1464-4343-8504-90c9bf2f3408" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 093ff62b-1464-4343-8504-90c9bf2f3408 of volume e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bfbf8c-4fe9-4446-a81a-83cfee379a4b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:57 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 Jul 03 13:12:57 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:57 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:12:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9bde2a-841e-4c3c-8652-d585fb14418c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:12:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:58 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 Jul 03 13:12:58 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:58 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:58 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 Jul 03 13:12:58 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:12:59 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jul 03 13:12:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:12:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:12:59 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408 Jul 03 13:12:59 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:00 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3.093ff62b-1464-4343-8504-90c9bf2f3408" returned: 0 in 0.691s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-093ff62b-1464-4343-8504-90c9bf2f3408" released by "_delete_snapshot" :: held 3.216s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-e9b4c4e3-04be-4f4a-9349-051c2388bed3" released by "delete_snapshot" :: held 3.238s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Created reservations ['d566f60c-5f71-472a-9f9b-5f2ed6317b18', '3bee108b-dd58-4164-acc6-767a6ed2009f', 'ebd9bca6-31fa-4c97-98c0-6e5cc4772112', '5cee1bc8-d4ba-4d2d-b486-bdfe3299f73f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:13:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0bbaf6a9-4bf8-44c6-a699-de812ab45cfb tempest-ProjectMemberTests-883586709 None] Lock "cinder-093ff62b-1464-4343-8504-90c9bf2f3408-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-e9b4c4e3-04be-4f4a-9349-051c2388bed3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Lock "cinder-e9b4c4e3-04be-4f4a-9349-051c2388bed3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-e9b4c4e3-04be-4f4a-9349-051c2388bed3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-e9b4c4e3-04be-4f4a-9349-051c2388bed3" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa335097-9864-49bd-8028-10dc30af0839]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:01 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 Jul 03 13:13:01 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:02 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:02 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:02 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:02 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3 Jul 03 13:13:02 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:02 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:02 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-e9b4c4e3-04be-4f4a-9349-051c2388bed3" returned: 0 in 0.674s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-e9b4c4e3-04be-4f4a-9349-051c2388bed3" released by "delete_volume" :: held 1.538s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Created reservations ['5e9ff60b-b47d-4b84-be6a-dc13e8532c47', '461f7478-36f8-4295-9013-8387ec6e3211', 'a43152fa-3dd9-4642-82e0-51bcc96a7793', '8fbba0a8-5543-46e7-bbc5-badfc2b4b35b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:03 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:03 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:03 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.801s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:13:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97f4b180-5a17-4eaa-be2d-77a4a5a81a78 tempest-ProjectMemberTests-883586709 None] Lock "cinder-e9b4c4e3-04be-4f4a-9349-051c2388bed3-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (da85e93d-37af-40a1-828c-2576cb569b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215f4c8-eae6-4a52-ba7f-5178d7791171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215f4c8-eae6-4a52-ba7f-5178d7791171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30301990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18690cd3-3d7d-468a-9f45-92f959d293a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:04Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4ff2ff-7229-4f41-a479-0ac1578d4639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4ff2ff-7229-4f41-a479-0ac1578d4639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccd9edf-a5b7-4494-b099-d28167084a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccd9edf-a5b7-4494-b099-d28167084a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18690cd3-3d7d-468a-9f45-92f959d293a1', 'volume_name': 'volume-18690cd3-3d7d-468a-9f45-92f959d293a1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad479a3-e977-4e3c-b91e-878c0be8b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad479a3-e977-4e3c-b91e-878c0be8b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26049099-8db0-415c-86d4-a95ffa8e91f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Volume 18690cd3-3d7d-468a-9f45-92f959d293a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18690cd3-3d7d-468a-9f45-92f959d293a1', 'volume_size': 1} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30301990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18690cd3-3d7d-468a-9f45-92f959d293a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:04Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Creating volume 18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:04 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:04 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 1073741824 Jul 03 13:13:04 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:05 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 1073741824" returned: 0 in 0.916s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:05 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 Jul 03 13:13:05 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:05 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1" returned: 0 in 0.673s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26049099-8db0-415c-86d4-a95ffa8e91f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18690cd3-3d7d-468a-9f45-92f959d293a1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153cd95b-1375-4c81-ac90-7f0390251021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Volume volume-18690cd3-3d7d-468a-9f45-92f959d293a1 (18690cd3-3d7d-468a-9f45-92f959d293a1): created successfully Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153cd95b-1375-4c81-ac90-7f0390251021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (da85e93d-37af-40a1-828c-2576cb569b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7dc0ce24-3a2a-49b9-b063-4a30e9ed1d41 tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=62,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=89,cinder:SELECT=55,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 81c6c31a-75ea-456c-af3f-451449dc7bea of volume 18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[01462bdf-0be3-4db9-8369-4864ea6c4916]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:06 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 Jul 03 13:13:06 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:07 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1" returned: 0 in 0.874s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:07 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea 1G Jul 03 13:13:07 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:08 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea 1G" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18690cd3-3d7d-468a-9f45-92f959d293a1 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:08 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18690cd3-3d7d-468a-9f45-92f959d293a1 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea Jul 03 13:13:08 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:08 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18690cd3-3d7d-468a-9f45-92f959d293a1 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea" returned: 0 in 0.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea is being set with open permissions: ugo+rw Jul 03 13:13:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:08 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea Jul 03 13:13:08 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (1ccab27f-93cb-4bad-987c-a55543e86a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c8b3b3-a5e7-4f93-b521-010423a20016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c8b3b3-a5e7-4f93-b521-010423a20016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771369919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b7f589-4e98-47b7-b5ce-d70213513a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:09Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace14a28-c88e-484a-b6b0-89d086b2a751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace14a28-c88e-484a-b6b0-89d086b2a751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473b6963-a878-4870-811d-2d699d081be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473b6963-a878-4870-811d-2d699d081be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b7f589-4e98-47b7-b5ce-d70213513a70', 'volume_name': 'volume-90b7f589-4e98-47b7-b5ce-d70213513a70', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bd521c-213b-4fbe-916e-dfe690ffda6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bd521c-213b-4fbe-916e-dfe690ffda6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6e4813-4b78-4a52-80a2-a12de10e7b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Volume 90b7f589-4e98-47b7-b5ce-d70213513a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b7f589-4e98-47b7-b5ce-d70213513a70', 'volume_size': 1} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:09 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea" returned: 0 in 0.704s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:09 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info Jul 03 13:13:09 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:10 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info" returned: 0 in 0.616s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:10 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info is being set with open permissions: ugo+rw Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:10 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info Jul 03 13:13:10 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:10 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.info" returned: 0 in 0.633s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771369919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b7f589-4e98-47b7-b5ce-d70213513a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:09Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Creating volume 90b7f589-4e98-47b7-b5ce-d70213513a70 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:10 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:10 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 1073741824 Jul 03 13:13:10 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a745cd4f-7285-48a8-bfc6-723db3b30846 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-81c6c31a-75ea-456c-af3f-451449dc7bea-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Lock "cinder-81c6c31a-75ea-456c-af3f-451449dc7bea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-18690cd3-3d7d-468a-9f45-92f959d293a1" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-18690cd3-3d7d-468a-9f45-92f959d293a1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-81c6c31a-75ea-456c-af3f-451449dc7bea" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-81c6c31a-75ea-456c-af3f-451449dc7bea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 81c6c31a-75ea-456c-af3f-451449dc7bea of volume 18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:13:11 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 1073741824" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15a039-c585-4b7a-b96b-41ff8cadd0cb]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:11 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 Jul 03 13:13:11 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:11 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea Jul 03 13:13:11 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:12 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6e4813-4b78-4a52-80a2-a12de10e7b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b7f589-4e98-47b7-b5ce-d70213513a70', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0db44a-b402-453f-92d0-80509514bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Volume volume-90b7f589-4e98-47b7-b5ce-d70213513a70 (90b7f589-4e98-47b7-b5ce-d70213513a70): created successfully Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0db44a-b402-453f-92d0-80509514bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:12 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (1ccab27f-93cb-4bad-987c-a55543e86a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18690cd3-3d7d-468a-9f45-92f959d293a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:13:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f83d5eb7-1036-41d6-b852-7f43a73cce9c tempest-ProjectReaderTests-674558331 None] Created volume successfully. Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff164c74-cee7-44a5-b188-2205ab6d4faf]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:12 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 Jul 03 13:13:12 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:13 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:13 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea Jul 03 13:13:13 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-90b7f589-4e98-47b7-b5ce-d70213513a70-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Lock "cinder-90b7f589-4e98-47b7-b5ce-d70213513a70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-quobyte-90b7f589-4e98-47b7-b5ce-d70213513a70" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-90b7f589-4e98-47b7-b5ce-d70213513a70" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c3344f-dda7-4910-a6af-d223a2ef674d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:14 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 Jul 03 13:13:14 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:14 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea" returned: 0 in 0.832s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:14 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea Jul 03 13:13:14 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:14 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70" returned: 0 in 0.816s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:14 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70 Jul 03 13:13:14 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:14 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1.81c6c31a-75ea-456c-af3f-451449dc7bea" returned: 0 in 0.722s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-81c6c31a-75ea-456c-af3f-451449dc7bea" released by "_delete_snapshot" :: held 3.241s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-18690cd3-3d7d-468a-9f45-92f959d293a1" released by "delete_snapshot" :: held 3.271s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Created reservations ['d152bbe6-3be7-4bab-b125-a467a3f2c280', '232c079b-1052-47c2-98b7-af4d34e13f34', '1fb8db0d-47c5-4343-9943-e91b6b273c4b', '394e5b33-cc97-4984-809c-4a9fa3aec398'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bf73bb4f-848c-4dea-934c-8d21da562e8b tempest-ProjectMemberTests-883586709 None] Lock "cinder-81c6c31a-75ea-456c-af3f-451449dc7bea-delete_snapshot" released by "delete_snapshot" :: held 3.428s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:15 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-90b7f589-4e98-47b7-b5ce-d70213513a70" returned: 0 in 0.694s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-90b7f589-4e98-47b7-b5ce-d70213513a70" released by "delete_volume" :: held 1.555s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Created reservations ['db94362b-779d-48e9-9cf0-65cf3202f4d6', '2663c6cf-e0fe-4390-925a-e517be26c592', 'a9eb63fd-8242-4ff7-ba4d-b348a19e97f3', 'dccb2745-f971-4f81-8e35-163fe7b150ce'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:15 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:15 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-18690cd3-3d7d-468a-9f45-92f959d293a1-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Lock "cinder-18690cd3-3d7d-468a-9f45-92f959d293a1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-18690cd3-3d7d-468a-9f45-92f959d293a1" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-18690cd3-3d7d-468a-9f45-92f959d293a1" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f797b8-eea5-44eb-995f-313026f44729]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:16 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 Jul 03 13:13:16 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:16 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.701s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Deleted volume successfully. Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a9063fe7-0ab1-4b5d-a87b-b660b361c09c tempest-ProjectReaderTests-674558331 None] Lock "cinder-90b7f589-4e98-47b7-b5ce-d70213513a70-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (3da570ca-a3fb-4f53-927f-06a94690eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84dec4c-f7f9-497c-804d-745e36fe53ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84dec4c-f7f9-497c-804d-745e36fe53ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423294263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4aba0b-de16-448e-a35d-27c46bd70c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:17Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fe73ef-c81f-48d5-9334-aaf2ed0dbeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fe73ef-c81f-48d5-9334-aaf2ed0dbeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b8378a-5a70-425b-95b4-2f429edb4a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b8378a-5a70-425b-95b4-2f429edb4a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4aba0b-de16-448e-a35d-27c46bd70c9a', 'volume_name': 'volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de69af2-869d-407d-bea2-3c51041a113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de69af2-869d-407d-bea2-3c51041a113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25056721-4865-4858-8346-dc966530267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Volume eb4aba0b-de16-448e-a35d-27c46bd70c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a', 'volume_size': 1} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423294263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4aba0b-de16-448e-a35d-27c46bd70c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:17Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Creating volume eb4aba0b-de16-448e-a35d-27c46bd70c9a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:16 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a 1073741824 Jul 03 13:13:16 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:16 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1" returned: 0 in 0.847s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:16 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1 Jul 03 13:13:16 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:17 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-18690cd3-3d7d-468a-9f45-92f959d293a1" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-18690cd3-3d7d-468a-9f45-92f959d293a1" released by "delete_volume" :: held 1.616s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:17 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a 1073741824" returned: 0 in 0.921s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Created reservations ['38a42024-0d77-4bfa-89a9-4b9e5ad3fc6c', '15e6aa8e-961a-4c65-a4ad-8e1fac324a4a', 'a85cd9cb-73c1-45dc-b30f-df4279caca01', '14a853d2-ead8-453e-b794-fffac3a3abbf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:17 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a Jul 03 13:13:17 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:17 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:17 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:18 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25056721-4865-4858-8346-dc966530267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c35f503-d1b6-4ea0-b1d8-81bd957fc18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Volume volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a (eb4aba0b-de16-448e-a35d-27c46bd70c9a): created successfully Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c35f503-d1b6-4ea0-b1d8-81bd957fc18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (3da570ca-a3fb-4f53-927f-06a94690eba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4d3b8563-4fae-421a-9121-c5b3fa536aa2 tempest-ProjectReaderTests-674558331 None] Created volume successfully. Jul 03 13:13:18 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-25b1eebe-a0d5-4086-bbd5-191732c01ff3 tempest-ProjectMemberTests-883586709 None] Lock "cinder-18690cd3-3d7d-468a-9f45-92f959d293a1-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (549e5246-130d-44ed-9f88-f96488cf09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6487234-bd7b-49a2-ada1-50c7d7e64b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6487234-bd7b-49a2-ada1-50c7d7e64b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1692431421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c9b742-5bee-40f4-8c7d-3d10a02d1a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:19Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a964f-fb10-4898-9879-390134ffca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a964f-fb10-4898-9879-390134ffca07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1aab4b-87f2-4851-ace7-339dc50c290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1aab4b-87f2-4851-ace7-339dc50c290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c9b742-5bee-40f4-8c7d-3d10a02d1a53', 'volume_name': 'volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a4172c-ce0b-4ad1-9a10-94fdaa13793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a4172c-ce0b-4ad1-9a10-94fdaa13793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cccce7-54d4-480c-9b00-fc6df5d289ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Volume 98c9b742-5bee-40f4-8c7d-3d10a02d1a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53', 'volume_size': 1} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1692431421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c9b742-5bee-40f4-8c7d-3d10a02d1a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:19Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Creating volume 98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-eb4aba0b-de16-448e-a35d-27c46bd70c9a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:18 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 1073741824 Jul 03 13:13:18 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Lock "cinder-eb4aba0b-de16-448e-a35d-27c46bd70c9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-quobyte-eb4aba0b-de16-448e-a35d-27c46bd70c9a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-eb4aba0b-de16-448e-a35d-27c46bd70c9a" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[572209e1-f4df-48c2-84d1-9ed0fcf592df]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:19 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a Jul 03 13:13:19 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:19 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 1073741824" returned: 0 in 0.938s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:19 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 Jul 03 13:13:19 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:19 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:19 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a Jul 03 13:13:19 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:20 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cccce7-54d4-480c-9b00-fc6df5d289ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:20 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d93a56-80c9-443e-adf4-79479ce7b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-eb4aba0b-de16-448e-a35d-27c46bd70c9a" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-eb4aba0b-de16-448e-a35d-27c46bd70c9a" released by "delete_volume" :: held 1.636s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Volume volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 (98c9b742-5bee-40f4-8c7d-3d10a02d1a53): created successfully Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d93a56-80c9-443e-adf4-79479ce7b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (549e5246-130d-44ed-9f88-f96488cf09f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-007a7a99-58c7-429c-946e-e2213f120a8b tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Created reservations ['7c3b059c-6441-4a10-91cb-bcee630dec5a', 'ea9064b4-6a5c-4884-bc91-0398c5e4f310', 'fb17a197-cf76-42ce-8e4e-60114266cca7', '15f90ecc-4236-43ea-8939-049c88d013f1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:20 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:20 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 of volume 98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[844effb4-e8df-4b89-ba04-42e605e6d97f]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:21 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 Jul 03 13:13:21 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:21 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Deleted volume successfully. Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0d07dcd1-72cf-46e4-9e2d-d895c70e902c tempest-ProjectReaderTests-674558331 None] Lock "cinder-eb4aba0b-de16-448e-a35d-27c46bd70c9a-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (6b6099f6-87d2-4224-bccf-0db8f18aa384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e85bba5-4d4d-4328-8c02-fc6cf3911a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e85bba5-4d4d-4328-8c02-fc6cf3911a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182805488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d600ed-aef0-41af-a715-e806e7f87b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:21Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0ceaea-6fe6-45f3-ab9b-c04af3f51065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0ceaea-6fe6-45f3-ab9b-c04af3f51065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d5bed8-4023-4c89-8cdb-fbb238e54258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d5bed8-4023-4c89-8cdb-fbb238e54258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d600ed-aef0-41af-a715-e806e7f87b10', 'volume_name': 'volume-d5d600ed-aef0-41af-a715-e806e7f87b10', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb0bf61-d13b-4ad9-b857-3789d363c8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb0bf61-d13b-4ad9-b857-3789d363c8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34812eb-a605-4e7b-bf4c-24e5f44ab065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Volume d5d600ed-aef0-41af-a715-e806e7f87b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d600ed-aef0-41af-a715-e806e7f87b10', 'volume_size': 1} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:21 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:21 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 1G Jul 03 13:13:21 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:22 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 1G" returned: 0 in 0.867s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:22 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 Jul 03 13:13:22 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:23 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" returned: 0 in 0.696s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:23 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 is being set with open permissions: ugo+rw Jul 03 13:13:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:23 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 Jul 03 13:13:23 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:24 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" returned: 0 in 0.674s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:24 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info Jul 03 13:13:24 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:24 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info" returned: 0 in 0.646s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:24 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info is being set with open permissions: ugo+rw Jul 03 13:13:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:24 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info Jul 03 13:13:24 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:25 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.info" returned: 0 in 0.676s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.906s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182805488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d600ed-aef0-41af-a715-e806e7f87b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:21Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Creating volume d5d600ed-aef0-41af-a715-e806e7f87b10 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:25 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:25 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 1073741824 Jul 03 13:13:25 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3de12683-2cb1-4a24-80e6-3acd4931a0e2 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:13:26 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 1073741824" returned: 0 in 0.951s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:26 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 Jul 03 13:13:26 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-f7d160ba-c4a0-41a3-b73f-5b19e49f70b9-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Lock "cinder-f7d160ba-c4a0-41a3-b73f-5b19e49f70b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 of volume 98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0b4e0-3219-4c15-ac4a-eef19793d6e1]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:26 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 Jul 03 13:13:26 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:27 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10" returned: 0 in 0.747s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34812eb-a605-4e7b-bf4c-24e5f44ab065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d600ed-aef0-41af-a715-e806e7f87b10', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f27f77-4840-42e0-b1df-281aa1decfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Volume volume-d5d600ed-aef0-41af-a715-e806e7f87b10 (d5d600ed-aef0-41af-a715-e806e7f87b10): created successfully Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f27f77-4840-42e0-b1df-281aa1decfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (6b6099f6-87d2-4224-bccf-0db8f18aa384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-98525426-667e-4cdf-83cb-42cc4ee1e07b tempest-ProjectReaderTests-674558331 None] Created volume successfully. Jul 03 13:13:27 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" returned: 0 in 0.913s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3c677-cc32-482c-879a-65723be892a0]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:27 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 Jul 03 13:13:27 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-d5d600ed-aef0-41af-a715-e806e7f87b10-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Lock "cinder-d5d600ed-aef0-41af-a715-e806e7f87b10-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-quobyte-d5d600ed-aef0-41af-a715-e806e7f87b10" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-d5d600ed-aef0-41af-a715-e806e7f87b10" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518ecde-a27d-444d-bbfb-d29f3d8cc13a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:28 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 Jul 03 13:13:28 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:28 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:28 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 Jul 03 13:13:28 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:29 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:29 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10 Jul 03 13:13:29 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:29 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:29 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9 Jul 03 13:13:29 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:29 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-d5d600ed-aef0-41af-a715-e806e7f87b10" returned: 0 in 0.750s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-d5d600ed-aef0-41af-a715-e806e7f87b10" released by "delete_volume" :: held 1.709s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Created reservations ['fb5714c0-1eac-45a9-9399-9ce244d28e82', '8bb55552-213f-4e13-9cf9-2d63188f7884', '67ea35d8-1ee9-4369-87da-686ca4c9580c', '95d43cfd-1e60-4c00-813f-ac8559772d81'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:29 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:29 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:30 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53.f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f7d160ba-c4a0-41a3-b73f-5b19e49f70b9" released by "_delete_snapshot" :: held 3.524s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" released by "delete_snapshot" :: held 3.550s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Created reservations ['fbee0264-99d1-41d9-83c1-e566384487be', 'ec6dda98-364b-42c9-8eb6-160a56ac23bc', '1f48b312-5807-4bc4-b4a5-5d908faaf63a', '9d77c9b9-eabe-4a28-8ee2-f34c7bef15a7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fb7ffb5f-5370-491f-a221-6d3f921cd2b7 tempest-ProjectMemberTests-883586709 None] Lock "cinder-f7d160ba-c4a0-41a3-b73f-5b19e49f70b9-delete_snapshot" released by "delete_snapshot" :: held 3.730s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:30 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Deleted volume successfully. Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (721a98e1-78be-4bfb-999f-3968f8dfaf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de38b19-9d6f-4a19-940c-98a0ff7b52a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9abd885f-4a94-46cb-80ce-71fd810319cf tempest-ProjectReaderTests-674558331 None] Lock "cinder-d5d600ed-aef0-41af-a715-e806e7f87b10-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de38b19-9d6f-4a19-940c-98a0ff7b52a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-439997130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f15b41-fff4-4eb7-aac1-47562a786f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:31Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fb3a93-904a-4c48-af2f-a6db922ea6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fb3a93-904a-4c48-af2f-a6db922ea6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dfffd1-64db-4625-808a-ab5c3418ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dfffd1-64db-4625-808a-ab5c3418ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f15b41-fff4-4eb7-aac1-47562a786f7f', 'volume_name': 'volume-16f15b41-fff4-4eb7-aac1-47562a786f7f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0846d309-b2a3-4cdc-961d-47d682d69a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0846d309-b2a3-4cdc-961d-47d682d69a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff4098e-666c-4064-9655-0ee2f62ffc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Volume 16f15b41-fff4-4eb7-aac1-47562a786f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f15b41-fff4-4eb7-aac1-47562a786f7f', 'volume_size': 1} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-439997130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f15b41-fff4-4eb7-aac1-47562a786f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3146c14de8f54c4082b04354de7dadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:31Z,use_quota=True,user_id='9a618ff3f2c046bd8a02560bf6313c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Creating volume 16f15b41-fff4-4eb7-aac1-47562a786f7f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:30 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f 1073741824 Jul 03 13:13:30 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-98c9b742-5bee-40f4-8c7d-3d10a02d1a53-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Lock "cinder-98c9b742-5bee-40f4-8c7d-3d10a02d1a53-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc2953-4d32-4747-b873-059533968c9d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:31 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 Jul 03 13:13:31 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:31 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f 1073741824" returned: 0 in 0.906s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:31 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f Jul 03 13:13:31 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:31 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" returned: 0 in 0.821s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:31 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53 Jul 03 13:13:31 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:32 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f" returned: 0 in 0.657s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff4098e-666c-4064-9655-0ee2f62ffc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f15b41-fff4-4eb7-aac1-47562a786f7f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060e8098-a773-45f6-a336-b76612f16a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Volume volume-16f15b41-fff4-4eb7-aac1-47562a786f7f (16f15b41-fff4-4eb7-aac1-47562a786f7f): created successfully Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060e8098-a773-45f6-a336-b76612f16a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Flow 'volume_create_manager' (721a98e1-78be-4bfb-999f-3968f8dfaf2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-61335777-aeb4-48ee-8c8e-1f2c6ff0e220 tempest-ProjectReaderTests-674558331 None] Created volume successfully. Jul 03 13:13:32 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" returned: 0 in 0.707s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-98c9b742-5bee-40f4-8c7d-3d10a02d1a53" released by "delete_volume" :: held 1.587s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Created reservations ['bcb1090c-45f1-4965-b4a9-cef300f9ca21', 'e43f3259-326f-4c03-a84d-3d034b3ade10', '1c58b915-394d-438d-95a7-ffa531173dfa', '67e4a138-3fe3-4889-a355-bb3d973a4d99'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:32 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:32 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-16f15b41-fff4-4eb7-aac1-47562a786f7f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Lock "cinder-16f15b41-fff4-4eb7-aac1-47562a786f7f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Acquiring lock "cinder-quobyte-16f15b41-fff4-4eb7-aac1-47562a786f7f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-16f15b41-fff4-4eb7-aac1-47562a786f7f" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e482b323-b39e-420b-ab0b-522fbae1570e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:33 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f Jul 03 13:13:33 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:33 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.745s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-144f0058-9156-4839-b022-5a2f4fe14537 tempest-ProjectMemberTests-883586709 None] Lock "cinder-98c9b742-5bee-40f4-8c7d-3d10a02d1a53-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (ce43e3b8-9c69-47d8-b89a-1e2850492f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6429caa0-3a1c-4e81-8033-8d41f02b5c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6429caa0-3a1c-4e81-8033-8d41f02b5c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685222814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41d91b0-fd5e-4262-956f-a5c5dc436209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:34Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa94aea-098b-4564-8a9f-fc8cc80908c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa94aea-098b-4564-8a9f-fc8cc80908c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e99b1e-1b8b-47a3-87fc-8fd9364f1f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e99b1e-1b8b-47a3-87fc-8fd9364f1f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41d91b0-fd5e-4262-956f-a5c5dc436209', 'volume_name': 'volume-f41d91b0-fd5e-4262-956f-a5c5dc436209', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a3ab1-47bd-4bd5-8041-fbb48ab7cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a3ab1-47bd-4bd5-8041-fbb48ab7cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d526b9-eb59-4475-a5fc-03e8c932e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Volume f41d91b0-fd5e-4262-956f-a5c5dc436209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41d91b0-fd5e-4262-956f-a5c5dc436209', 'volume_size': 1} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685222814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41d91b0-fd5e-4262-956f-a5c5dc436209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:34Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Creating volume f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:33 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:33 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 1073741824 Jul 03 13:13:33 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:33 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f" returned: 0 in 0.924s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:33 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f Jul 03 13:13:33 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:34 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-16f15b41-fff4-4eb7-aac1-47562a786f7f" returned: 0 in 0.658s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Lock "cinder-quobyte-16f15b41-fff4-4eb7-aac1-47562a786f7f" released by "delete_volume" :: held 1.637s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Created reservations ['fa1e924c-5a8c-4062-9eb3-4ebda489c149', '8d5e6708-791a-49d2-9066-2ae08f05aca6', 'c17b4ebf-0e9b-41d4-8c78-4aaa54c8d9ec', 'ab59e1c5-3033-4a94-b9b2-b3f67ee23163'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:34 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 1073741824" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:34 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:34 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:34 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 Jul 03 13:13:34 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:35 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:35 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Deleted volume successfully. Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d526b9-eb59-4475-a5fc-03e8c932e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41d91b0-fd5e-4262-956f-a5c5dc436209', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e9f746-be56-4ccb-9867-09a44b08c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-52ec1990-0795-4803-890e-c6d044435f97 tempest-ProjectReaderTests-674558331 None] Lock "cinder-16f15b41-fff4-4eb7-aac1-47562a786f7f-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Volume volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 (f41d91b0-fd5e-4262-956f-a5c5dc436209): created successfully Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e9f746-be56-4ccb-9867-09a44b08c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (ce43e3b8-9c69-47d8-b89a-1e2850492f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b3697b82-ceb5-482a-b654-9f3be1959b59 tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 14e0d84b-6e08-4d39-aebc-59f833443966 of volume f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08c754-5c74-4b42-b142-29ced6b7c3f3]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:36 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 Jul 03 13:13:36 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:36 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:36 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 1G Jul 03 13:13:36 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:37 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 1G" returned: 0 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:37 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 Jul 03 13:13:37 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:38 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966" returned: 0 in 0.712s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:38 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 is being set with open permissions: ugo+rw Jul 03 13:13:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:38 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 Jul 03 13:13:38 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:39 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:39 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info Jul 03 13:13:39 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:39 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info" returned: 0 in 0.620s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:39 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info is being set with open permissions: ugo+rw Jul 03 13:13:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:39 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info Jul 03 13:13:39 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:40 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.info" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.402s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-417fd410-6139-4709-9d3d-7c3c9cb7f7da tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-14e0d84b-6e08-4d39-aebc-59f833443966-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-14e0d84b-6e08-4d39-aebc-59f833443966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-f41d91b0-fd5e-4262-956f-a5c5dc436209" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f41d91b0-fd5e-4262-956f-a5c5dc436209" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-14e0d84b-6e08-4d39-aebc-59f833443966" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-14e0d84b-6e08-4d39-aebc-59f833443966" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 14e0d84b-6e08-4d39-aebc-59f833443966 of volume f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a5700-4bdd-4f57-8008-167794bb1c75]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:41 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 Jul 03 13:13:41 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:42 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966" returned: 0 in 0.768s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41d91b0-fd5e-4262-956f-a5c5dc436209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:13:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb96abc-6122-41e8-930f-aef7c5f43b8b]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:42 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 Jul 03 13:13:42 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:42 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:42 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 Jul 03 13:13:42 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:43 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966" returned: 0 in 0.750s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:43 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966 Jul 03 13:13:43 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:44 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209.14e0d84b-6e08-4d39-aebc-59f833443966" returned: 0 in 0.652s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-14e0d84b-6e08-4d39-aebc-59f833443966" released by "_delete_snapshot" :: held 3.143s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f41d91b0-fd5e-4262-956f-a5c5dc436209" released by "delete_snapshot" :: held 3.168s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Created reservations ['e352d22a-7b64-4ae3-bb05-06d51b2cae8f', '801cd95d-ddca-4c47-ace7-e56a35f11a67', '2069fdf1-83ca-453c-bf5d-90c8a7f13819', 'e48c3188-b95a-443c-8695-0f2c246332ac'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:13:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6597de77-69f4-477c-9100-f364c4bea1d9 tempest-ProjectMemberTests-883586709 None] Lock "cinder-14e0d84b-6e08-4d39-aebc-59f833443966-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-f41d91b0-fd5e-4262-956f-a5c5dc436209-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-f41d91b0-fd5e-4262-956f-a5c5dc436209-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-f41d91b0-fd5e-4262-956f-a5c5dc436209" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f41d91b0-fd5e-4262-956f-a5c5dc436209" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b474e912-3458-4a74-b226-0ff79919bd6c]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:45 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 Jul 03 13:13:45 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:46 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:46 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209 Jul 03 13:13:46 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:46 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-f41d91b0-fd5e-4262-956f-a5c5dc436209" returned: 0 in 0.651s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-f41d91b0-fd5e-4262-956f-a5c5dc436209" released by "delete_volume" :: held 1.503s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Created reservations ['48ac89f5-1b9f-46a5-8c6f-7bca5ec6e6bc', '666f2216-7f0c-40b4-b497-d9437e8cfeee', '068b357d-0629-4a9a-b38a-6fb3c67254e6', 'b76598b5-c050-491c-a25e-eecc514c1f9b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:47 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:13:47 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:47 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:13:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:13:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2241d0be-2ef1-45da-bdd7-fc78030f86e4 tempest-ProjectMemberTests-883586709 None] Lock "cinder-f41d91b0-fd5e-4262-956f-a5c5dc436209-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (43ce0347-e17c-4751-8d7c-495d0e494845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfc98c8-412d-42f8-9287-5bd74fe7f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfc98c8-412d-42f8-9287-5bd74fe7f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426776499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc445a27-072e-4a98-a997-bfc4399a27a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:48Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ce0a4-05a2-454c-87d0-01969bfdcde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ce0a4-05a2-454c-87d0-01969bfdcde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f64aaee-2a82-4f2f-8195-41a7380bfc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f64aaee-2a82-4f2f-8195-41a7380bfc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc445a27-072e-4a98-a997-bfc4399a27a8', 'volume_name': 'volume-bc445a27-072e-4a98-a997-bfc4399a27a8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6a50a5-23aa-432b-8318-3dad31a897e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6a50a5-23aa-432b-8318-3dad31a897e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0171eb3-d5e8-4344-9a68-7da3bd30f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Volume bc445a27-072e-4a98-a997-bfc4399a27a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc445a27-072e-4a98-a997-bfc4399a27a8', 'volume_size': 1} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426776499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc445a27-072e-4a98-a997-bfc4399a27a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789a3f696df943d9a3c9ec7c522af68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:48Z,use_quota=True,user_id='0be1e86231114e80be61ed9649141110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234352f-a816-4aa5-bdde-1bdf16743614),volume_type_id=d234352f-a816-4aa5-bdde-1bdf16743614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Creating volume bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Selected osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:13:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] casted to osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514 Jul 03 13:13:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:48 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 1073741824 Jul 03 13:13:48 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:49 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 1073741824" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:49 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 Jul 03 13:13:49 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:49 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0171eb3-d5e8-4344-9a68-7da3bd30f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc445a27-072e-4a98-a997-bfc4399a27a8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3643155-d752-438c-9b1d-52137e538c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:13:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Volume volume-bc445a27-072e-4a98-a997-bfc4399a27a8 (bc445a27-072e-4a98-a997-bfc4399a27a8): created successfully Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3643155-d752-438c-9b1d-52137e538c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:13:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Flow 'volume_create_manager' (43ce0347-e17c-4751-8d7c-495d0e494845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:13:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-328881f4-6aba-4fc9-817c-82284a065578 tempest-ProjectMemberTests-883586709 None] Created volume successfully. Jul 03 13:13:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:13:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:13:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Creating offline snapshot 3f1ea701-0871-46e8-9690-18d5d9dd7c30 of volume bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:13:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a6234b-064a-4d49-91c1-f71beeb3c23e]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:50 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 Jul 03 13:13:50 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:51 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8" returned: 0 in 0.768s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:51 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 1G Jul 03 13:13:51 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:52 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 1G" returned: 0 in 0.892s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc445a27-072e-4a98-a997-bfc4399a27a8 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:52 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc445a27-072e-4a98-a997-bfc4399a27a8 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 Jul 03 13:13:52 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:52 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc445a27-072e-4a98-a997-bfc4399a27a8 -F qcow2 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:52 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 is being set with open permissions: ugo+rw Jul 03 13:13:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:53 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 Jul 03 13:13:53 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:53 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:53 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info Jul 03 13:13:53 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:54 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info" returned: 0 in 0.663s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info is being set with open permissions: ugo+rw Jul 03 13:13:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:54 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info Jul 03 13:13:54 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:55 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.info" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.543s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:13:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4faab289-6a58-4088-94a9-f39e2be0a749 tempest-ProjectMemberTests-883586709 None] Create snapshot completed successfully Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-3f1ea701-0871-46e8-9690-18d5d9dd7c30-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Lock "cinder-3f1ea701-0871-46e8-9690-18d5d9dd7c30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-bc445a27-072e-4a98-a997-bfc4399a27a8" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-bc445a27-072e-4a98-a997-bfc4399a27a8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-3f1ea701-0871-46e8-9690-18d5d9dd7c30" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-3f1ea701-0871-46e8-9690-18d5d9dd7c30" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Deleting offline snapshot 3f1ea701-0871-46e8-9690-18d5d9dd7c30 of volume bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] snapshot_file for this snap is: volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[09305399-e1b4-4970-bd20-1fd6b98e266d]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:56 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 Jul 03 13:13:56 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:56 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc445a27-072e-4a98-a997-bfc4399a27a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:13:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[485ccdaa-dd32-4469-be79-4c87d92e9f9a]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:13:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:56 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 Jul 03 13:13:56 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:57 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:57 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 Jul 03 13:13:57 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:58 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:13:58 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30 Jul 03 13:13:58 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:13:59 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Jul 03 13:13:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8.3f1ea701-0871-46e8-9690-18d5d9dd7c30" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:13:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-3f1ea701-0871-46e8-9690-18d5d9dd7c30" released by "_delete_snapshot" :: held 3.113s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-bc445a27-072e-4a98-a997-bfc4399a27a8" released by "delete_snapshot" :: held 3.139s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:13:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Created reservations ['66ed5586-f703-499c-97fd-820a5e3a3dfe', '42fadd68-e851-49cf-b4db-7ca9bb99c247', '1582c38c-5337-4223-8cb9-4bb55e32b03b', 'b6063a3c-588e-491a-a191-9605ee6821ee'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:13:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Delete snapshot completed successfully. Jul 03 13:13:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-270c7a26-3851-4714-9a01-08045b4bf6a2 tempest-ProjectMemberTests-883586709 None] Lock "cinder-3f1ea701-0871-46e8-9690-18d5d9dd7c30-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-bc445a27-072e-4a98-a997-bfc4399a27a8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Lock "cinder-bc445a27-072e-4a98-a997-bfc4399a27a8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Acquiring lock "cinder-quobyte-bc445a27-072e-4a98-a997-bfc4399a27a8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-bc445a27-072e-4a98-a997-bfc4399a27a8" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[23555b95-d79e-4ce9-b425-45795e318425]: (4, 'qcow2') {{(pid=88134) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:14:00 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 Jul 03 13:14:00 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:14:00 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8" returned: 0 in 0.748s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:14:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:14:01 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8 Jul 03 13:14:01 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:14:01 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5/volume-bc445a27-072e-4a98-a997-bfc4399a27a8" returned: 0 in 0.607s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Lock "cinder-quobyte-bc445a27-072e-4a98-a997-bfc4399a27a8" released by "delete_volume" :: held 1.424s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Created reservations ['62955cae-63fd-491e-8121-1a5aac1f0c60', 'b015f694-3335-47ff-b470-9113831c5540', '8c4006d7-f792-4bf6-aacf-009d06910032', '64a86da1-1f14-45ef-b29f-9973d88ca45e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:14:01 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:14:01 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:14:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c661e9a2-3691-49ed-a29b-5325c06b1514'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:14:02 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5 Jul 03 13:14:02 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:14:02 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.720s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:14:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Deleted volume successfully. Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6c270368-df93-4609-99df-359f9d51ecae tempest-ProjectMemberTests-883586709 None] Lock "cinder-bc445a27-072e-4a98-a997-bfc4399a27a8-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:14:02 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e089e1b53a5a0f8d404c22c09c6d50a5" returned: 0 in 0.752s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:14:02 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2e5f8953-8219-4119-8f78-07ff935fbc1b None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:14:11 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=90,cinder:UPDATE=106,cinder:INSERT=28,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:14:12 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=74,cinder:UPDATE=120,cinder:DELETE=15,cinder:INSERT=31 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}